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Cost estimation has been defined by Batchelder, [Ref. 1] 
as: "А judgement or opinion regarding the cost of an objec- 
tive, commodity, or service." This judgement or opinion may 
be arrived at formally or informally by a variety of methods, 
all of which are reliable guides to the future. The major 
purpose of the cost estimation is long range planning or 
contract negotiation. The problem of estimating the procure- 
ment cost of major weapon systems iS particularly important. 

Traditionally, cost estimates for military weapons sys- 
tems acquisition have been derived through Industrial Engineer- 
ing (IE) techniques. These techniques are extremely time- 
consuming and require detailed information about the proposed 
equipment. In recent years estimates have been made using 
Cost Estimating Relationships which is defined by Baker 
[Ref. 2], as: "An estimate which predicts cost by means of 
explanatory variables such as performance characteristics, 
physical characteristics, and characteristics relevant to the 
development process, as derived from experience on logically 
related systems." 

Cost Estimating Relationships (CERs) are mathematical 
equations which relate system costs to various explanatory 
variables. They are most generally derived through statis- 
tical regression techniques on historical cost data. There 


are several reasons why CERs have been and will continue to 





be important in the acquisition process. Early in the process 
when many alternative designs are contemplated, a CER based on 
readily available performance characteristics as explanatory 
variables allows the decision maker to evaluate the cost 
impacts of the various design and make trade-offs accordingly. 
Recognizing the need for and usefulness of a CER is the easy 
part. Developing a reliable CER is difficult at best. There 
are many problems the analyst must overcome in achieving this 
Ex identifying and collecting the data is the first and 
most difficult obstacle. The availability of CERs to the 
weapons S а process has received considerable 
attention in part because a reasonably large number of weapons 
systems have been procured since 1950 for which cost informa- 
tion is available. Several techniques/methods for determining 
an appropriate CER have been tried and are continually being 
improved. 

This thesis's objective is to present a general procedure 
for development of a parametric cost estimates and to develop 
a model for the prediction of the total procurement cost of 
destroyer type naval ships that increase in precision. This 
thesis was limited to destroyer type ships to reduce the scope 
of the problem and also because of the author's experience 
and familiarity with this type ship. 

This thesis consists of nine-chapters. A review of the 
general procedure for development of a parametric cost esti- 


mate is presented in Chapter III. Even though there are 
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numerous studies about CER and several ship Cost Estimating 
Models, the author would like to present and contrast two 
sample models related to ship cost model in Chapter IV. One 
1s the Escort Ship Cost Model (ESCOMO) developed by the 
Center for Naval Analysis (CNA) using performance character- 
istics such as maximum speed, type of weapons and sensors, 
endurance, range, etc. The other is RMC Cost Model developed 
by the Resource Management Corporation (RMC) using phvsical 
input characteristics such as weight, powerload, number of 
EEDSrator, etc. 

Two models were to be developed and examined using the 
data base in Chapter VI. One model is disaggregated into 
nine-subsystems for estimates of total cost estimate. The 
other is a single total cost estimation equation. The primary 
Criteria for comparing the predictive value of these models 
is the estimates of variance associated with each model. This 
estimates of variance is to be derived in two different ways, 
as discussed in Chapter VII. Finally, these two models 
developed in Chapter VI will be compared with the  RMC MODEL 
to the best estimate available within the Naval Sea Systems 


Command. 
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APPROACHES TO COST ESTIMATION 


Traditionally, weapon system cost estimates have been 
prepared using industrial engineering techniques. These 
techniques involved detailed studies of the operations and 
materials required to produce the new system. The cost 
estimate frequently required several thousand hours to pro- 
duce with voluminous supporting documentation. Changes in 
design require extensive changes in these estimates. In 
spite of ail the time and effort involved in preparing these 
E mites, there is considerable uncertainty remaining. This 
is evidenced by the large cost overruns cited by the annual 
GAO reports to Congress. Several consequences of these over- 
runs have been: г 


1. A decrease in the public's confidence in the manage- 
rial ability of military leaders. 


2. Acquisition of weapon systems that were not cost 
effective. 


3. Forced reductions in the number of units purchased 
in order to stay under an imposed ceiling on the 
weapon system's acquisition cost. 

4. Financial hardships experienced by military con- 
tractors in trying to meet unrealistic price 
estimates. 

Within the last decade, a second major approach to cost 

estimation has come into prominence. Independent parametric 
cost estimation has received considerable attention in the 


Department of Defense as a means of increasing the accuracy 


of cost estimates. This procedure is based on the premise 
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that the cost of a weapon system is related in a quantifiable 
way to the system's physical and performance characteristics. 

Parametric cost estimates (PCE) can provide estimates 
during the concept formulation stage of the acquisition 
process before detailed engineering plans are available. 
These early cost estimates can be used to: 


1. Identify possible cost/performance tradeoffs in the 
design effort. 


2. Provide a base for cost/effectiveness review of per- 
formance specifications. 


3. Provide information useful in the ranking of competing 
alternatives. 


4. Suggest a need for identifying and considering new 
alternatives. 


Historical cost data incorporate system development set- 
backs such as engineering and design specification changes. 
and other items that are not identifiable at the time of 
design. Industrial engineering (IE) estimates tend to be 
optimistic in that they don't allow for unforeseen problems. 
Unexpected engineering or design changes usually bring about 
unexpected increases in system cost. Cost estimating 
relationships based on historical data will incorporate some 
of these unknowns into the cost estimate. 

In the late stages of a weapon system's development, PCE's 
Can serve as a comparison in reviewing the industrial engineer- 
cost estimates as they become available. Any large unexplained 
differences between the PCE and IE cost estimates should 


indicate to the decision maker that something may have been 
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left out in either cost analysis and that further analysis 
may be needed. Parametric cost estimating is not intended 
to replace the IE estimates. t should be used along with 


the IE estimate to improve the accuracy of the final cost 


estimate. 
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ІІІ. METHODOLOGY FOR THE DEVELOPMENT OF A PARAMETRIC COST 
ESTIMATE 

The methodology that follows draws heavily upon the 
material presented in Ref. 14 and several documents with 
limited distribution. Many of the ideas and techniques 
contained in these references are presented here in a format 
acceptable for unrestricted distribution. 

An outline of the PCE development algorithm is presented 
in Figure 1. An algorithm consists of the procedural and 
decision steps that a cost analyst would follow in the develop- 
ment of the PCE. The boundaries between the individual steps 
are not as well defined as indicated in the figure. Several 
steps may be worked on simultaneously and the sequence of 
steps may be altered to fit the particular Situation. Each 
step in the algorithm with its objectives, requirements, and 
decision criteria will be discussed separately. Steps l 
through ll will be discussed in the development of a ship's 
hull subsystem CER to be used in the preparation of a PCE. 
Discussion of alternative methods of CER/PCE development will 
be presented in steps 12 through 14. 

Step 1: Define the Problem and Its Objectives. 

The analyst should initially strive to obtain a clear 
understanding of what is expected of him and the environment 
in which he has to work. Answer to the following questions 


should provide the necessary insight. 
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1. What is the purpose of the analysis? Who is the 
ultimate client and what decision will be made on 
the basis of the analysis? 


2. What is the scope of the analyst's responsibility? 
He should be alert for opportunities to formulate 
new alternatives and include these in the analysis. 


3. How much time is available in which to complete the 
project? The amount of time available can influence 
both the types of data sources used and the degree 
of model refinement. 


4. Is there any other person or agency working on the 
Same projects? Has work been done on any similar 
or related projects? Often the analysts counter- 
part in another service or in MND will have had some 
experience in the project area. 


5. What major sources of data and technical expertise 
are available? Data and associated information may 
be available in the project office or outside sources 
of information may have to be located and contacted. 


6. What degree of accuracy is required in the analysis? 
What are the consequences of the cost estimate being 
too low or too high? The need for accuracy generally 
increases as the number of competing alternatives 
increases. If the analyst produces a cost estimate 
that errors on the high side, that particular alter- 
native may be dropped because it seems to be too 
expensive. If the cost estimate errors on the low 
side, the prospect of a cost overrun would increase. 
The consequences of these possible errors were dis- 
cussed in the previous chapter. 


7. The analyst should be well aware of what is meant by 
an "independent" cost analysis. There should be open 
lines of communication between the independent cost 
analyst and the project manager. Independence does 
not mean that information available to the project 
manager should be withheld or disregarded. However, 
an independent attempt at evaluating such information 
is a necessity. Evaluation can be in the form of 
cross checks by using alternative techniques or 
information and reassessment of the unknowns and 
System requirements and definition. 


The better the analyst prepares himself for the assigned 


project, the better job he will be able to do. An analyst 
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must have not only a thorough understanding of the analysis, 
he must also be familiar with the system he is working on. 


Step 2: Acquire Background. 

"An analyst should have a good knowledge of the kind of 
equipment with which he is dealing -- its character- 
istics, the state of its technology and the available 
sample." [Ref. 2] 

Due to the wide diversity of weapon systems used by each 
of the services, an analyst will quite often not have a good 
technical background for the particular project he is assigned. 
Before the analyst is able to provide the authoritative 
analysis expected from him, he must have a good working 
knowledge of the systems involved. This is essential in order 
to evaluate both reference materials used and the final report 
produced. The two best methods of obtaining the required back- 


ground are: 


1. Reading texts and technical reports dealing with the 
subject area. 


2. Consulting with technical experts in the field. 
Typical questions that should be answered during this 
phase include: 


1. What parameters are used in describing the equipment 
or system? 


Cost estimating relationships (CER) can be divided into 
two major categories: input and output. Input CER's are 
functions of the system's input parameters such as weight, 
volume, density, number of component parts, operating 
temperatures and pressures, and in general, parameters used 


in the physical description of the system. Output CER's are 
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functions of the system's output parameters. These are the 


parameters that are measures of the system's capabilities 


such as speed, operating range, payload, range of detection, 


etc. 


The input and output parameters should not be combined 


into one CER Since problems with multicollinearity between 


the variables are likely to be encountered in such a model 


and statistical tocls will become unreliable. Separate input 


and output CER's should be developed and this will provide 


the analyst with two different cost estimates for comparison. 


D. 


B. 


What are typical values of these parameters and how 
and why have they changed over time? 


What are the values of these parameters for the new 
system? Have any new parameters been developed or 
become necessary to describe it? 


What is the current state of the art and how has 
this changed over the course of the equipment 
development? 


What is the state of the art required for the new 
system? Can the new system be constructed using 
current technology or must new breakthroughs occur 
before production of the system is feasible? 


What are the basic physical laws that determine 
equipment operation and what is their relationship 
with the system's descriptive parameters? 


Once the analyst has acquired sufficient background, he 


will be in a position to determine: 


Type of data to be collected. 
Possible sources of data. 


The kind of adjustments required to be made in the 
data. 
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Answers to several of the questions above are partially 
obtained through the data collection effort itself. The 
boundary between this step and the next is not well defined 


and parts of each may be done simultaneously. 


ВЕ: Select an Approach for the Parametric Cost Estimate 
Development 


This step represents the first decision point that an 
analyst would normally encounter. The opinions available are: 

1. Utilize existing system cost models. 

2. Develop new cost models for the entire system. 

3. Break the system up into component subsystems and 

use a separate model for estimating the cost of each 
Component. 

If parametric cost estimates have been developed for 
systems similar to the one under consideration, a search of 
the literature should produce the supporting documentation. 
Cost models have been extensively developed for ships, air- 
craft, and aircraft engines. Reference ll contains a biblio- 
graphy of existing cost estimateing models. Modifications 
of these existing models may have to be made to fit the 
proposed system and this process is discussed further in 
Step 12. 

An initial data search should indicate the level to which 
cost data is available. If cost data is available on compo- 
nent parts of past systems, it may be possible to break the 
new System down into similar components and then estimate 


their cost separately. The process of breaking the systems 
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down into its components is called disaggregation. An 
advantage gained by disaggregation is the likelihood of 

better identifying the relationships between costs and the 
system's parameters. Another is that some component costs 

are well known. The analyst should be alert for opportunities 
to disaggregate. Further guidance for this procedure is 
provided in Step 13. 

Quite often the only source of cost data available is the 
contract price which is generally an aggregated cost of the 
system and related support items. This would dictate that 
the cost prediction models developed from it could be used 
only to estimate total system cost. Input and output CER's 
could be developed from the cost data depending on the avail- 
ability of parametric data. 


step 4: Acquire Data. 


"Acquisiton of data is the process of identifying, search- 
ing out, acquiring, verifying, and recording the specific 
information that is of value to the analyst." [Ref. 3] 
There are two basic categories of data that must be col- 

lected, each with its own unique problems. 
l.  Parametric data 
The analyst should set down the definitions of exactly 
what each parameter measures. Very seldom will different data 
sources use identical parameter definitions. Notes should be 
kept of the adjustments that will have to be made so that all 


the data satisfies the parameter definitions. If the analyst 


starts with definitions and uses them as benchmarks during 
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MiSs collection efforts, his data collection problems will 
be decreased significantly. 
2. Cost Data 

Collection of cost data can be one of the most frus- 
trating periods for the analyst. Chapter two of Reference 3 
contains a very good summary of the complications involved in 
collecting cost data. The aforementioned reference, or similar 
Refs should be consulted prior to the initiation of cost data 
collection. 

Data collection will constitute the largest effort in 
any cost analysis problem. The Cost Information Report (CIR) 
was established by DOD in 1966 to help alleviate the data 
collection problem. This reporting system was designed to 
collect cost and related data on major contracts for aircraft, 
missiles, and space programs. A newer system called Contract 
Cost Data Reporting (CCDR), has been instituted, In the 
absence of CIR type data, the analyst must resort to contract 


records, Managerial records, or periodicals containing cost 


data such as the Annual Market Intelligence Reports, DPA 


nce Procurement Agency) Market Price Report. 
While collecting data, the analyst should be keeping 


in mind the levels of accuracy and aggregation that he needs. 
If cost data is available down to the component level, it may 
be possible to proceed with a disaggregated method of cost 

estimating. No matter what approach is used, data collection 


problems can be minimized by first becoming familiar with 
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the system's technology and second, by using consistent 
definitions for the cost and parametric variables. 
Step 5: Normalize the Data. 

Before any analysis is applied to the data, the data must 
be consistent and comparable. Data is normalized to decrease 
the effects of definitional difference, production quantity 
differences and yearly price changes. Price indices, learning 
curve factors and the definitions of the parameters are used 
to make the required adjustment. Listed below are several of 
the data adjustments often needed. 

l. Cost Definition Adjustments 

Different contractor accounting practices and types of 
contracts are the primary reasons for this type of adjustment. 
An analyst should state the cost definition that he wishes to 
use, and then adjust the data to meet his definition. It 
is sometimes impossible to obtain information needed for 
consistent adjustment. Interpretation of the final cost 
estimate should make allowances for this possible source of 
cost behavior. 

2.) Price Level Adjustment 

It is all too apparent that inflation changes the 
purchasing power of the dollar dramatically. In order to 
compare the cost of system purchased in 1953 to the cost of 
a new system, the cost figures must be adjusted to "constant" 
dollars. The Bureau of Labor Statistics publishes many 


indices that can be used for this purpose. With sufficient 
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data, specifically for the type of system being estimated this 
can be a very laborious process and so several general indices 
are available for use. The Korean Ministry of National Defense 
publishes a procurement index to be used for general military 
hardware. It is almost an impossibility to obtain an index 
that will remove ali of the price level changes. Best results 
are obtained from indexes which are specialized to the type of 
equipment being estimated. 

oe Cost Quantity Adjustments 

The "Learning Curve" is a phenomenon prevalent in many 

industries. As the cumulative number of identical items pro- 
duced doubles, the unit cost or cumulative average cost is 
reduced by a constant percentage. For example, in a 90% 
learning curve, as the cumulative output is doubled, the 
unit cost decreases by 90$. Here the cost of unit #5 is 
56, the cost of unit #10 is (.9) (5.56) = $5.00. Cost 
curve information can be obtained from two possible sources. 
One source is the contractor cost records for individual 
units. Another source of information would be a general 
indstry-wide learning rate that may be published in the 
industry's literature. 
step 6: Develop Hypotheses. 

A statistical hypothesis is an assumption about the 
population being sampled or the relationship between combina- 
tions of variables. Numerous statistical techniques have 


been developed to determine the validity of these types of 
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hypothesis. There are two categories of hypotheses that 


should be developed by the analyst during his data collec- 


tion effort. The first type deals with the compatibility 


of the different subsets and can be aggregated together into 


one data base. The second type of hypotheses is developed 


around the relationships between cost and the explanatory 


variables. 


Це 


plotted 

obvious 
1) 
2) 
3) 
4) 
5) 


Aggregation hypotheses 


Figure 2 contains a chart of ship's construction cost 
against light ship weight of observations. It is 
that there are five distinct subsets of data: 

General destroyer type ship (DD) 

Escort type ship (DE) 

Destroyer with missile type ship (DDG) 

Escort with missile type ship (DEG) 

Major fleet escort with missile type ship (DLG). 


The question to be considered is whether or not these 


five subsets of data can be aggregated into one data set to 


be used 


to construct a СЕК for the prediction of the cost of 


a new destroyer type ship. “here are three possible solutions: 


a. 


Use only the appropriate data, 1.е., use only the 
general destroyer type ship data to predict the new 
system's cost. 


Include dummy variables in the regression models to 
identify that subset to which the data point 
belonged. 


Combine the subsets and conduct tests on the final 


regression model to determine if other variables in 
the model accounted for the difference in the weight 
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variable. The "Chow test" is a good method for 

testing the hypothesis that different subsets of 

data are from the same population. 

2. Functional form hypotheses 

The second type of hypothesis to be formed is developed 
around the relationships between cost and the explanatory 
parameters. Costs are normally expressed as a function of the 
independent parameters with unknown coefficients. For example, 
the cost of a system is normally thought to be correlated 


with weight. A simple hypothesis expressing this would be: 


Cost = a + bW + e 


a = constant term 

b = unknown coefficient (cost/ton) 
W = system weight 

e = error term 


More: complex models can be developed as other relevant 
parameters are considered. The choice of parameters will 
depend on the systems’ underlying technology. Parametric 
Studies made on similar types of equipment can often suggest 
analogous hypotheses for consideration. Several hypothesis 
may be formed in this step and validity of each can be tested 
during subsequent steps. 
تک‎ 7: is Refinement Needed? 

After the initial data collection effort, the analyst 
should evaluate his data matrix. In order to use a specific 
parameter in a model, there should be a value of that para- 


meter presented for each observation in the data base. The 
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analyst may reach the conclusion that he does not have enough 
information in his data matrix to evaluate the hypotheses 
that he has formed. Possible alternatives are: 


1. Collect more data to improve and enlarge the data 
base. 


2. Limit the selection of hypotheses to make use of 
only those parameters for which there is a full 
set of observations. 

3. Estimate the missing parameter values. Graybill 
(Кек. 10, p. 125] suggests a method of inverse 
estimation to provide a point estimate of the missing 
variable. A confidence interval for the missing 
variable can also be calculated. It is not known 
how the estimated value of the missing parameter 
biases the prediction abilities of the final model. 
Therefore, this technique should be used with care 
and as a means of last resort. If the analyst has 
the time he should strive to obtain the missing 
alte. 

After his data collection effort the analyst might find 
that he has enough cost data to disaggregate the system into 
its component parts and then estimate the cost of the individ- 
ual components. If cost data is available at the component 
level, the analyst should proceed to steps 13 and 14, the 
aggregation method of system cost estimating. 
step 8: Develop the Cost Estimating Relationship 

The specific analytical procedures used in the develop- 
ment of a CER will depend on the analyst and the computing 
facilities available to him. Most computer facilities will 
have statistical regression programs stored in the machine 
ready for use. The particular characteristics of a program 


should be studied and understood before using the program. 


Least squares estimation is the most commonly used method 
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of regression analysis. References 9 and 10 are excellent 

sources of information on least squares procedures. Figure 3 

contains the outcome of a least squares regression performed 

on the data in Table I. The illustrated regression line is: 
Cost = 0.005 3 + 0.0013 (ENGPAY) 

An analyst who obtained such a model should be concerned 
with the question: how well does the equation fit the data? 
There are several statistical measures that can give indica- 
tions of the ability of the model to describe the data. 

The most commonly used measure of the "Goodness of Fit" 


of the regression equation is the Coefficient of Determination 


2 Explained Variance 
Total Variance of the Dependent Variable 

The coefficient of determination is the percentage of the 
variance in the data explained by the regression model. 
Ideally an analyst would want an RC to approach 1.00. An R^ 
Of .73 was obtained from the example regression model above. 
This relatively low value indicates that one independent 
variable, ENGPAY representing the summation of engineering 
and payload weight, alone does not explain all of the data. 
The remaining variance may be explained when other variables 
are considered and brought into the equation. 

Figure 3 shows the relationship graphically. The solid 
line indicates the regression line and the dashed lines repre- 


sent the standard error of estimate. The greater the disper- 


sion of the observed values of cost about the regression line, 
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the less accurate the estimates that are based on that line 
are likely to be. If the cost data follow a Normal distri- 
bution, approximately 68 percent of the data points should 
fall in the area bounded by the two standard error lines. 
The standard error lines should not be confused with the 
prediction intervals constructed around point estimates. 
Standard error is a measure of the dispersion of the data 
and its relation to prediction intervals is discussed in the 
next step. 

In comparing the standard error of one model to that of 
another, it is useful to compute a relative standard error 
of estimate. The Coefficient of variation (CV) is such a 
measure which relates the standard error of the mean value 
Еке dependent variable. A value less than 20 percent for 
the CV is desirable. 

The standard error of the model presented above is $ 
0.6045 and the coefficient of variation is: 

CNS SEC = 026045/2.5306 = 0.238 

С = mean value of the dependent variable. 
This high value of the CV also serves as an indication that 
the proposed model is not well suited to the data. 

In the process of constructing the CER, several models 
may be developed and evaluated together using the statistical 
measure mentioned above. The analyst should not be concerned 
with just maximizing oe There should be a logical and, if 


possible, a sound technologically based reason for trying a 
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Figure 3. Hull Cost CER 
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particular model structure. For example, logarithmic trans- 
formation of the variable will often raise B^ but it may also 
result in poorer estimates in the region of interest. The 
number of variables used should be restricted to those which 
have a logical basis and that are non-duplicating. It is 

best to use only input related or output related explanatory 
variables in one CER. There is a tendency to manipulate 
models to obtain a high БЕ and then later try to determine 

why that model produced such a high correlation. This back- 
order approach should be avoided since it undercuts the founda- 
tion of CER's and it can lead to serious problems when making 
the cost estimate for a new system. 

Step 9: ا‎ the Models. 

It has been previously mentioned that there are several 
Statistical measures that can be used in evaluating a model. 
The coefficient of determination (R^) and the standard error 
(SE) are the most commonly used measures. In addition to 
these, the adjusted multiple correlation coefficient should 
be checked. The adjusted multiple correlation coefficient 
is an adjustment made to the coefficient of determination for 
the number of degrees of freedom present in the model. If 
the number of degrees of freedom of the model is small, an 
overly optimistic picture of the performance of the explana- 
tory variables may be obtained from gU. 

If a model contains coefficients that are not signifi- 


cantly different from zero, the associated variables should 
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be dropped from the model and the model should then be deter- 
mined from the significant variables. The signs and the 
magnitudes of the coefficients should also be studied. If 
cost is expected to increase with weight, then a CER contain- 
ing a negative coefficient for weight would not make sense. 
If the CER had a large negative constant term that produced 
negative cost estimates for a part of the data base, then 

the CER would not be valid over the full range of the data 
base. A sensitivity analysis of the CER should be conducted 
to determine how the model responds to changes in the para- 
meter values. If the model is fairly insensitive to changes 
in a prameter that is felt to be highly correlated with cost, 
then the analyst should question the suitability of the 
model. 

There are a few hard and fast rules to be used in evaluat- 
ing a model. The models’ statistics must be looked at in 
combination since no single statistic can be a meaningful 
indication of the model's applicability. However, more than 
statistical measures are needed to analyze a CER. The analyst 
must satisfy himself that the model will accurately predict 
costs. 

If the analyst is not completely confident of the model, 
the following may prove to be useful: 


l.  Recheck the definitions used for the parametric 
and cost data. 


2. Validate any questionable data points that lie out- 
side the expected range of values. 
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3. 


4. 


۶۰ 10: 


Determine if any relevant parameters have been 
overlooked. 


Develop new hypotheses to be tested. 


Prepare the Cost Estimate. 


The cost estimate is calculated by substituting the para- 


meters of the proposed system into the CER. The cost figure 


obtained from the model is a point estimate of the actual cost 


and a prediction interval should be constructed around the 


estimate to describe the uncertainty of the estimate. When 


both input and output CER's are used, their point estimates 


and associated prediction intervals should be compared. It 


1s very unlikely that the estimates will be the same. The 


interpretation and weighting of the cost estimates is up to 


the analyst. 


In 


should 


7 


addition to evaluating the cost estimates the analyst 


consider the following potential problems. 


Estimates for systems which contain a major advance 
in the state of the art beyond the systems in the 
model's data base. The analyst should be aware that 
a model based on old technology may incorrectly esti- 
mate the cost of a new system containing advanced 
technology. 


Very often the parametric values of the new system 
will lie outside the range of values contained in the 
data base. This requires extrapolation and faith 
that the model continues to be valid. If the amount 
of extrapolation is large, the analyst should care- 
fully consider the possible errors inherent in the 
estimate. 


An analyst should not blindly trust the estimate obtained 


from the CER. The estimate must be tempered with careful 


reasoning before being put into use. Cost estimating 
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relationships are usually constructed to estimate the cost of 
БИ с: лед unit (first production unit, tenth production unit, 
etc.). The learning curve adjustments made in the normaliza- 
tion of the data will determine what unit cost is being 
estimated. Contracts normally cover the purchase of numerous 
identical units for a given total cost. The analyst must 
convert the estimated unit cost into an estimated total pur- 
chase cost. Here again learning curves play a very important 
role in cost estimating. The amount of learning experienced 
by a contractor can have a significant effect on total pro- 
duction cost. Total purchase cost can be easily determined 
using the unit cost obtained from the learning the CER and 
the learning curve tables contained in Reference 5. Several 
estimates of the total cost can be obtained by using different 
estimates of the learning curve slope. These estimates should 
be studied to observe how the total purchase cost can vary 
as the learning rate is changed. 
Beep 11: Document the Model. 

The material presented in this step is taken from the 
documentation procedures presented in reference 14. 

It is important to document a newly developed CER so 
that future users of the model may study it to any degree 
desired. Much of the material required by the guidelines 
given below should have been collected during the development 


of the model. 
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1. Indicate the purpose, objectives and final user of 
the analysis. 


2. Describe the input data used and any adjustments 
performed on either the independent or dependent 
variables. 


3. Identify sources and dates of the data. 


4. Define each dependent and independent variable used 
in the analysis. 


5. Provide scattergrams of the dependent variables vs. 
the explanatory variables used in the analysis. 


6. Document the final model by including its relevant 
statistical information in the report. 


7. Prepare a table for the final model including the 
observed values of the dependent variable, the 
estimated values and the residuals. A scattergram 
showing the observed costs plotted against the 
estimated costs should also be included. 


8. List the alternatives models that were considered 
and the reasons why they were rejected. 


9. State the major hypotheses that were formed and 
tested during the development of the model. 


10. Provide an example to illustrate the procedure for 
using the final cost model. 


ll. Describe the limitations of the final model. Include 
the range of the data and any other restrictions on 
the population covered by the model. 

The material called for by the guidelines above is a 
minimum of the documentation needed. An analyst should keep 
in mind the following principle while compiling model docu- 
mentation: The model should be well enough documented so 


that any potential user could reconstruct the model from the 


information contained in the final report. 
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Step 12: Modify Existing Cost Estimating Models. 


Considerable analysis has been performed to develop CER's 
for equipment such as aircraft airframes, gas turbine engines, 
ship hulls and related equipment. Reference 11 contains a 
brief summary of existing documentation available on cost 
estimating models. An analyst might find that he will be 
able to use some of the existing CER's on his current project. 
Use of existing models can save considerable time and effort, 
but they can also produce some erroneous cost estimates. 

The question to be considered is whether or not the existing 
model is completely applicable to the present project. If 

the existing model is not completely suitable, can the model 
be adjusted to reflect the changes inherent in the new system? 

In order to evaluate an existing model, its documentation 
must be examined to determine what are the contents of the 
model's data base and what assumptions were made in the model's 
derivation. If the existing model was developed to predict 
the cost of airframes made out of steel and aluminum, can it 
be used to predict costs of an airframe that includes the 
use of titanium? Or, if the model is based on data for fixed 
wing aircraft, what adjustments would be needed to use it to 
predict costs for a variable geometry winged aircraft? These 
questions are not easily answered even if the existing model 
is fully documented and is understood by the analyst. 

Reference 8 provides some examples of how existing CER's 


were modified to represent the system under consideration. 
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The procedures mentioned below are but a couple of the tech- 


niques that can be applied to existing CER's. 


I. 


The control system for the new missile represented a 
departure from the sytems used on missiles in the 
data base. Weight of the control system was the 
explanatory cost variable in the model and it was 
felt that the new type of system should cost 15 per- 
cent more on a pound for pound basis than the systems 
in the data base. The CER was adjusted by the addi- 
КООП ОГ а multiplicative term of 1.15. 


old CER: C =a + bW 
new CER: C = (a + bW) 1.15 


The problem with this type of approach is determining 
the appropriate factor to add to the CER. This fac- 
tor should be based on sound opinions from experts 

in that particular area of technology. 


The CER for the warhead section of the missile was 
also a function of weight, but the new warhead had 

a component in it that was not presented in the war- 
heads in the data base. An additive term was 
included in the CER to reflect the use of the new 
component. 


olda CER: C 


a + bWc 

new CER: C = a + bWc + d 
It was felt that the new component's cost could be 
determined from other sources and its cost could be 
simply added to the cost obtained from the old CER. 
Again, competent sources of information must be 
utilized to provide the needed adjustment. 
A third possible method of modifying CER's can be 
obtained by combining parts of existing CER's. If 
the old CER had the form of 

(1) C » a + bW 


and the CER hypothesized for the new system had : 
another variable V in it. 


(2) C = a + DW + cV 
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the analyst could search for other CER's for Similar 
equipment that had the variable V in it such as: 


(3) C =A + bD + cV 
If CERs 1, 2, and 3 were compatible enough in regards 
to their data bases and uses, the coefficient c in 
model 3 could be added to model 1 to produce the 
desired model. The problems encountered with this 
method deal with multicolinearity between the 
variables D and V, the coefficient of V will not 
accurately represent the actual relationship between 
eest and V. 

The problems encountered with using existing CER's can 
be numerous. Using one blindly without being familiar with 
its development could produce cost estimates containing con- 
siderable error. The analyst must decide for himself if it 
would be easier to develop a new CER or spend the time and 
effort involved in becoming familiar with and possibly modi- 
fying an existing model. If any modifications are made, they 
must be based on sound technological considerations. Possibly 
part of the data base used in the development of the existing 
model could be used in the development of a new but related 
CER. 

Ер 13: Disaggregation of the System. 

Quite often it is undesirable to try and estimate the 
total system cost with the use of just one CER. Systems may 
be broken down into components and then each component cost 
can be estimated separately. The individual component costs 
can then be reaggregated statistically into the system's 


total cost. For each component part, costs may be broken 


down in the following manner: 
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4. 


Initial Engineering 
Direct Material 
Direct Labor 


Overhead 


The exact breakdown used for a particular system would 


depend on the availability of the appropriate data. Some of 


the advantages, disadvantages and requirements of the dis- 


aggregation approach are: 


E. 


Steps 2 through 10 or Step 12 must be used for each 
component cost estimate. This will require a con- 
Siderable amount of time and effort on the part of 
the analyst to obtain his necessary data and back- 
5۶17168 information. 


Disaggregation may prove to be useful when a hypo- 
thesized CER for the total system contains many 
independent variables and the data base is limited 
in size. Each subsystem CER should require fewer 
and perhaps different variables than the ones 
required for the aggregated system. 


mie likelihood of identifying and utilizing func- 
tional forms based on technology improves as the 
level of disaggregation increases. Cost uncertainty 
of the total system can be reduced by estimating 
each component cost from a CER expressly. 


Care must be taken to ensure that no parts are left 
out or duplicated when disaggregating the system. 

If disaggregation is carried too far, it will require 
considerable time and report and will approach the 
Industrial Engineering approach to cost estimation. 


A cost estimating relationship will provide an analyst 


with a point estimate of cost. Prediction intervals developed 


to be placed around this point are based on the assumption 


meee the distribution of cost follows a Normal distribution. 


This normality assumption leads to a distribution of costs 


depicted below. 
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When the number of data points is small, this assumption 
can be difficult to make. Generally, information in addition 
to the point estimate is available to the decision maker 
regarding the establishment of upper and lower bounds of the 
estimate. A lower bound could be the price of a similar but 
less sophisticated piece of equipment that is already available. 
An upper bound could be the maximum price that the decision 
maker is willing to pay for the equipment before looking for 
new alternatives, although such a consideration introduces 
additional factors. The point estimate obtained from the CER 
may be termed the most likely estimate and it is represented 
by the high point in each graph below. In addition to being 
able to state his high and low cost bounds, the decision maker 
may have some intuitive feel for the distribution of the cost 
estimates. Both figures in Figure 4 have the same most likely 
cost estimates, but the top figure displays a situation where 
there is a very high probability of exceeding that estimate. 
The lower figure illustrates just the reverse. 

Quite often the Beta distribution is used to describe cost 
distribution because it has finite limits and an infinite 
variety of unimodal shapes that can be assumed. This variety 
of shapes can be used as figured in Figure 4 describe the 
particular characteristics of the estimate under consideration. 
The individual Beta distribution can be aggregated to provide 
a total cost distribution, also a Beta distribution, that 
incorporates the various uncertainties contained in the 


individual cost estimates. 
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Figure 4. Beta Distribution 


Reference 13 contains an excellent discussion of the pro- 
cedures to follow in determining the individual Beta 
distributions. Reference 7 illustrates an example of how 
this procedure has been applied by OP-96D in preparing 
independent parametric cost estimates of major weapon 


systems. 
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step 14: Aggregation of Component Costs 
Step 13 described a methodology for breaking up a system 


into its component parts and then estimating the cost of 
each. In order to get a total system cost the component 
costs must be aggregated together. One method of doing this 
would be simply to add together the most likely cost for each 
component. This would be statistically incorrect unless the 
component cost distributions have certain additive properties. 
It would also be inappropriate because much of the information 
regarding the cost variances would be lost. The uncertainty 
in each component cost estimate has been qualified by the 
Есе of a cost distribution. Cost distributions are likely 
to be quite diverse in the range of costs covered and their 
associated form. In order not to lose the information pro- 
vided by the individual cost distributions, the cost estimates 
should be combined statistically using procedures such as the 
Summation method or the Mean square residual method which wiil 
be discussed in Chapter VII. 
Summary of Methodology 

The methodology for the development of a parametric cost 
estimate was studied from step 1 through step 14 according 
to the PCE development algorithm using the Ship's Hull cost 
data. The cost estimate of a certain system depends on 
analysts and given data and time, but the general method of 
PCE would be similar to the procedures of this paper. Several 
steps may be worked on simultaneously and the sequence of 


steps may be changed to meet the particular situation. 
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Step 13 suggested a method for breaking a complex system 
up into its components and then estimating the cost of each 
component in order to get a total system cost. The component 
cost must be aggregated together. This method was utilized 
in this paper. 

Finally, it must be noted that the method of modifying 
existing models (step 12) is very dangerous. Using one 
blindly without being familiar with its development could 
result in considerable errors. Therefore, an analyst must 
decide himself whether to develop a new model or to modify 


an existing model very carefully. 
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ШО 05ت 7 8 جک ب۶۶۷1‎ ESTIMATING MODELS 


E ESCORT COST MODEL, 
1. General Description 
ESCOMO is a statistically derived model produced at 
the Center for Naval Analysis. It is used to estimate end 
costs of new escort ships. The purpose of this model is to 
relate costs to performance characteristics of a ship sub- 
stituting for the more traditional method of having costs 
related to physical characteristics like weight, shape, 
et. ... The former procedure made it quite difficult and 
sometimes even impossible to analyze and understand how per- 
formance affects costs and how these costs can in turn be 
related to desired benefits. 
. Research was then undertaken to derive statistical 
CER's between the end costs and the performance characteristics 
of escort ships [Ref. 6]. The definition of End Costs in 
this model is Total costs including Basic contract cost and 
Government Furnished Materials (GFM). Production character- 
istics were also included in the model, like quantities of 
ships built, the number of builders and the dates in which 
the ships were built. 
2. Results of Analysis 
In conducting an analysis, it was hypothesized that 


the end costs can be quantitatively related to their major 
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performance and production characteristics. After analyzing 

100 conventionally powered escorts, the natural logarithm(ln) 

of End Cost equation was established: 

(1) LADJS =-0.9778 + 0.088 MAXSP + 0.57 LCRWF + 0.09 LSORNR 
(12.8) (S22) (3.84) 


0 0025 ORD - 05102 LSOYD 


(5.27) (-4.32) 
LADJS = ln of end costs adjusted to 1970 Mi of dollars 
MAXSP = maximum speed in knots 
LCRWF = ln of crew factor (quotient of full load 
displacement by crew accommodations) 
LSNOR = ln of sonar index 
ORD = ordnance index (С&М) 
LSQYD = ln of building sequence number by class within 


the same shipyard 
The number in parentheses below the coeficients are the 
t-statistics of those coefficients. 


F-statistics = 266.2 


Multiple correlation coefficient (в?) = 0.934 
Standard error of the estimate (SE) = 0.13 
Durbin Watson statistic = 2.00 
Coefficient of Variation (CV) = 0.036 


The values of the t-statistics, F-statistics and 
Durbin-Watson statistic indicate significance at the 95$ 
level of confidence. The Durbin-Watson statistic indicates 


no autocorrelation in the residuals. Therefore, the 
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hypotheses that end costs are related to certain variables 
that describe major performance and production characteris- 
tics in escort ships is accepted. 

Even though a CER has been derived to estimate the 
logarithm of end cost, we are interested in predicting not 
the logarithm of cost, but cost itself. Several steps are 
required to develop an estimating relationship to predict 
cost. First, the antilogarithm of both sides of eq. (1) is 
taken to transform it to an exponential equation. The form 


of this equation is: 


0.087984 MAXSP 0257554 


(2) expLADJ& = 0.37615 e CRWE 
0.090806 0.0025353 ORD =) 10201 
SONAR e | SOYD 
expladJ$ - antilogarithm of LADJS 
0.37615 = antilogarithm of -0.97778 
MAXSP = max speed in knots 
CRWF = crew factor 
SONAR = sonar index 
ORD = ordnance (gun and missile) index 
SQYD = building sequence by shipyard and class 


As the distribution of EXP LADJ is lognormal, CER 
equation does not estimate the mean of the distribution of 
EXP LADJ$. Therefore, it must be multiplied by a corrective 
factor which is the antilogarithm of the quotient of the 
variance of LADJS divided by two, that is 1.1312. The equa- 


meron can then be rewritten: 
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0.087984 MAXSP 037554 


CERLOO: ADJS = 0.42550 e CRWF 
0.090806 0.0025353 ORD -0.10201 
SONAR = SQYD 
where: 
ADJ $ = End cost adjusted to 1970 
41255 = 0.376 * 1.1312 


The other variables being the same as before. 

CER 100 is an exponential equation that can be used 
to predict escort ship end costs from five explanatory vari- 
ables that describe four performance characteristics and one 
production characteristic. This relationship was derived 
from statistical analysis of the costs and characteristics 
of 100 escort ships built for the Navy during the 1950's and 
1960's. It could be used as the basis for estimating the end 


costs of future escorts. 


Bee eMC COST MODEL 
ie General description 

The RMC COST MODEL was developed by Resources Manage- 
Ment Corporation (RMC) for estimating the cost of new construc- 
tion in civilian shipyards (as opposed to government-owned 
Shipyards) [Ref. 12]. 

The purpose of this noe is to relate costs to physi- 
cal characteristics like weight, shape, etc. while the ESCOMO 
model is to relate costs to performance characteristics of a 
ship. RMC approached in deriving CERs from the 13-year data 


base (1954-1966). The approach consisted of a stratification 
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of the data into six groups according to ship type such as 
aircraft carrier, destroyer, submarine, auxiliary, amphibious, 
patrol/minesweeping. 

RMC employed the linear least squares regression tech- 
nique to develop CERs from the historical data base on ship 
construction costs for each ship subsystem; hull, propulsion, 
electrical, communication and control (C&C), auxiliary, out- 
fitting, armament, design and engineering, construction 
services. The ship's characteristics as independent variables 
were obtained from various sources such as Ships data book, 
Contractor's accepted estimates, Navy contract design 
estimates. These variables generally consisted of character- 
istics that could be estimated long before ship construction 
began, such as subsystem weight (hull, armament, etc.) per- 
formance specifications (range, maximum speed, etc.). A 
complete listing of all the characteristics included in the 
data base by RMC may be found in Appendix B. 

p Besults of analysis 

The basic contract costs of each subsystem were then 
utilized as dependent variables for which CERs were developed. 
The established CERs are in Table II. The basic contract 
cost was defined as the summation of these nine cost cate- 
gories plus profit and the total cost of the ship was the 
summation of these basic contract costs plus the cost of 
electronics, weapons and miscellaneous items, added after 


Completion of basic ship construction (end-cost item). 
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TABLE II 
9-GROUP BASIC COST CERs 


(millions of dollars) 


Ball cost 

CER Y = -0.870 + 0.00144 HULWGT + 3.794 NUC + 22.652 AR/LSW 
Propulsion cost 

may = 2.090 + 0.00640 PROWGT + 17.461 NUC - 0.0790 SERIES 
Electrical cost 

PERTY = 0.134 + 0.283 GEN + 0.00350 ELEWGT + 2.310 NUC 
Communication and control cost 

БЕК Ү - 0.237 + 0.00361 C&CWGT + 1.513 NUC 

Auxiliary cost 

CER Y = 0.09582 + 0.00176 PROWGT + 0.00295 AUXWGT 
Suctaicting cost 

CER Y = 0.150 + 0.00544 OUTWGT 

Armament cost 

CER Y = -1.453 + 0.0068 ARMWGT + 1.151 DEDEG 

Design and Engineering cost 

CER Y = -1.0520 + 0.00667 ARMWGT + 0.00156 PROLSW 
Construction service cost 


CER Y = -0.01090 + 0.000241 LSW + 1.131 МОС 
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V. DATA BASE 


One Significant point should be addressed before proceed- 
ing further. It is understood that the use of contract bid 
data for predictive purpose is not an optimal procedure. It 
would be much more desirable to utilize actual ship construc- 
tion costs if these costs were available. However, this is 
not the case. During the period from which this data was 
collected (1954-1966), cost accounting systems differed 
greatly among the various contractors, making it virtually 
impossible to obtain data on a uniform level of aggregation 
and in a manner suitable for the objectives of this thesis. 

In addition, bid costs are really prices in the ship- 

0 industry and are thus subject to price fluctuation. 
Some types of ships can only be built by certain shipyards 
due to the required level of expertise in electronics or 
weapons systems, for example. The bids on these ships could 
reflect a "monopoly" effect. Some shipyards are fully em- 
ployed in the building of both naval and commercial ships. 
These shipyards might have a lower overhead, and thus produce 
lower bid prices, than shipyards that were not operating at 
full capacity. Thus, bids costs can be affected by many 
variables, some of which are not directly concerned with the 
construction costs of a specific ship. 

However, contractor bid data is the most meaningful data 


available for the period under study (1954-1966). Using 
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this data at least allows a preliminary effort to be made in 
deciding which ship's characteristics determine construction 
costs and within what limits of accuracy these estimates 


might fall. 


A. DATA ADJUSTMENT 
1. Bid cost data 
Contract raw bid data was adjusted in three specific 
ways to remove cost variances due to other than ship's 
characteristics, as follows: 
a. Cost definition adjustment. 
b. Cost quantity adjustment. 


с. Price level adjustment. 


шшеношесе level adjustment. In this paper, the 


installation of Government Furnished Equipment (GFE) by the 
contractor required significant adjustments, especially in 
the propulsion category. To achieve consistency, the cost 
to the government of GFE was added to the appropriate cost 
group since the contractor's bid represented only the cost 
of installation and not the cost of the GFE. The cost plans 
supplied to the builder from an external sources was added 
to cost group 8, design and engineering. Again, this was 
done to achieve an accurate and consistent cost breakdown. 
The cost guantity adjustment implies that the cost of 

ship construction decreases progressively with each ship in 


a procurement lot. The information necessary to adjust for 
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the learning effect was derived from NAVSHIPS FORM 4282.2, 
UNIT PRICE ANALYSIS CONSTRUCTION, which lists contractor 
estimates for the nine different construction cost groups, 
subdivided into three categories: direct labor, direct 
material and overhead costs. An overall average learning 
curve slope was determined for all ships to apply to labor 
hours and material dollars for each of the 9 basic contract 
groups. The average learning curve slope for the data was 
ШЕШУ for 210 ships of all types (DD, AE, LSD, MSC, SSN, 
etc.), for which 19 bids were for 4 or more ship lots, 73 
bids for 3 ship-lots, and 118 bids for 2 ship-lots [Ref. 12]. 

UNE ice level adjustment refers to the variation 
of prices, productivity and wages over time. This data base 
ma@etuded construction data from 1954 to 1966. To remove the 
temporal effects inherent in this data, 1965 was chosen as 
the base year, and all data from other years was adjusted to 
the base year by means of standard shipbuilding industry 
indices for price, productivity and wages. 

The order in which these adjustments were made to 
the data was as follows: 


l. application of the learning curves produced data 
representing one unit costs. 


2. adjustments, using 1965 indices, produced data 
representing one unit costs in 1965 dollars. 


3. addition of the cost of GFE and plans, produced 


data representing all basic contract costs, on a 
consistent level, as unit one costs in 1964 dollars. 
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In most cases these adjustments involved relatively 
small dollar differences between raw and adjusted data. For 
the base year, one comment is necessary. The cost quantity 
adjustment was carried out in terms of inflated dollars since 
the price level effects were treated after the cost quantity 
adjustments. A reversal of this order of treatment would 
produce different final dollar values. An explanation con- 
cerning the order of treatment would have been appropriate. 

Zee End Cost Data 

End cost data was 0ھ‎ much the same way that 
Contractor Bid Data was adjusted. Two specific adjustments 
[Ref. 12] were made to the raw End Cost Data, as follows: 


а. Cost quantity adjustment utilizing a slope of 96.8 
percent. 


b. An adjustment for price level based on general ship- 
building, electronics, and ordnance indices with 
1965 as the base year. 

The two adjustments listed above provided small and 


consistent changes between raw and adjusted data, and were 


therefore accepted as reasonable. 


В. THESIS DATA BASE 

The adjusted values for Basic Bid and End Cost Data 
were accepted as a point of departure for this analysis of 
destroyer construction costs. However, one objective of 
this thesis is to examine Basic Bid and End costs 
Simultaneously. Therefore, the End cost data were aggregated 


with the Basic Contract Cost data as follows: 
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a. Electronics End Cost was added to command and 
control cost, 


b. Weapons End cost was added to Armament cost, and 


с. Miscellaneous End cost was added to construction 
services cost. 


The thesis data base is the adjusted construction cost 


data for 36 ships. These 36 ships are as noted in Table III. 


TABLE III 


THESIS DATA BASE SHIP TYPES 


Dype Data available 
DD E 
DDG КЕ 
DE II 
DEG 2 . 
DLG 9 
TOTAL 36 ships 


This breakdown of ship types in the data base cannot be 
considered as a representation of the proportion of each 
type ship in either the current or future Navy. The general 
purpose destroyer (DD) is obviously underpresented with only 
3 ships in the data base. Thus, the data base could be con- 
Sidered as being biased toward guided missile ships (22 out 
of 36 ships). There is no way to correct a possible bias 
except by attempting to use weighted average values (weight 
the average figures for each ship type by the proportion of 


that type in the current or proposed Mavy) or selectively 
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dropping some of the DDGs/DLGs to gain a more correct pro- 
portional representation. However, there are relatively 
few ships (36) in the data base, and average figures tend 
to eliminate possibly important differences among ships of 
the same class. Also, there is no really objective way to 
determine the proportional breakdown of ships in a future 
Navy. For these reasons, it was decided to use the data 
base as given, while recognizing a possible bias. The data 
base is not truly homogenous since it contains five dif- 
ferent types of ships. They are all.bound together under 
the general heading of surface combatant ships. However, 
major differences exist, as follows: 

1. DD - general purpose destroyer; good shore gunfire 


Support capability; ASW capability; poor AAW 
capability. 


2. DDG - general purpose destroyer with good gunfire 
Support, ASW and AAW capability. 


3. DE - ocean escort with good ASW capability only. 


4. DEG - ocean escort with good ASW and close in AAW 
capabilities. 


5. DLG - major fleet escort; extra communication and 
control equipment; good ASW and best AAW capabilities. 


It is obvious that a DE cannot perform all of the same 
missions that a DLG can perform. Even so, each data point 
is given the same weight in the data base. In reviewing 
the data, it was noted some DLG type ships had significantly 
high costs in the following areas: hull, outfitting, con- 


struction services, weapon and cost, and electronics end 
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cost. In addition, as described earlier, the DLG type ship 
can be considered to have a different operational mission 
than the smaller, less expensive destroyer type ships. How- 
ever, a single group data will be considered since there 

are relatively few ship cost data in this thesis. 

Using the data base, a CER will be developed using two 
different methods of cost disaggregation schemes. One is 
each 9-subsystems cost group CER. The other is summation of 
9-subsystem cost groups CER. This data contains 36 physical 
characteristics for each ship in numerical form. This 
characteristics is essentially design parameters such as 
maximum speed, maximum draft, number of generators, hulls, 


armament, etc., those are listed in Appendix B. 
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VI. DATA ANALYSIS 


А11 the data was fed into the "MINITAB" statistical 


program to use linear regression technique. In part A, a 


general discussion of independent variable selection cri- 


teria is followed by a detailed discussion regarding the 


development of each CER. In part B, CERs and a summary of 


statıstical information relevant to each CER was listed. 


РА DEVELOPMENT OF CER 


کت 


in each 


a. 


Б: 


Criteria 
The choice of independent variables to be employed 
CER was based upon several criteria: 


Each independent variable should denote a subjectively 
logical causal relationship with cost. 


Each explanatory variable should exhibit a high 
correlated with dependent variable and a high degree 
of statistical independence from all other explanatory 
variables used in the same CER. This will be examined 
by correlation matrix. 


Each variable should be input oriented, implying that 
its value could be obtained with a high degree of 
certainty before ship construction began. 


Each CER should have higher ТЕ (coefficient of 
determination). Addition of additional explanatory 
variables can never decrease R?, the increase may be 
marginal and not worth the additional complexity. 
The point at which the increase in R2 ceases to be 
meaningful can then be used to determine the best 
subset of independent variables. 


A value of 20 percent or less for the CV (coefficient 
of Variation) is desirable. CV is a measure which 
relates the standard error of the model to the mean 
value of the dependent variable. 
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f. Residual plot against the computed residual value 
for predicted value for the dependent variable. 
Each residual plot was examined for points that 
appeared to be outliers and for any indication ЕЕ 
a need for any type of transformation. 

g. The t-statistic of the coefficient of each variable 
should be significant level under proper assumptions 
oL normality. 


h. Finally, the F-statistic of each CER should prove 
significant of the regression line at the 0.999 level. 


2. Discussion of CER Development 

With each CER, work was begun by an examination of 
variables having subjectively logical cause-effect relation- 
ship between explanatory variables and cost followed by an 
examination of the correlation matrix of the dependent 
versus each independent variable selected. Next, the variables 
highly correlated with the dependent variable except high 
intercorrelated independent variables (multicollinearity) 
were regressed using 'MINITAB' statistical package. During 
the analysis, residuals were plotted against the predicted 
value for the dependent variable. 

Each residual plot was examined for points that 
appeared to be outliers and for any indication of a need for 
any type of transformation. Eventually a best model was 
selected to be the CER for each of the 9 subsystems and the 
Single total cost equation model. 

In the statistics given for each CER the F-ratio is 
the test value for the hypothesis that the regression is not 


Significant. If the F-ratio is larger than the table value, 
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the hypothesis is rejected and the R 


2 


1s considered significant. 


The t-value for each independent variable is used to test the 


hypothesis that the coefficient of the variable in equation 


equals to zero, the hypothesis is rejected if the table value 


is less than the t-value. 


а. 


2- SUBSYSTEM MODEL 


(1) HUEL COST CER 


Hull cost was available for seven variables 


selected by logical cause effect relationship subjectively. 


The correlation matrix for those variables examined is 


listed below: 


HULL COST ENG PAY 


PRAXWGT 


ENG PAY 


LSW 


ENGWGT 


ARMWGT 


PROWGT 


PRAXWGT 


HULLWGT 


о 35 


with hull cost. 


0.854 
0.847 
0.846 
08/8 
0.784 
0.838 


07279316 


091 
0.986 
0.946 
um 8 
0.980 


0.908 


However, 


LSW 


0.953 
0.886 
0.836 
0.936 


02972 


ENGWGT 


0.964 
0959 
0.998 


0.864 


ARMWGT PROWGT 
0-965 

0371 0.973 
0.768 0:693 


All of these variables are highly correlated 


Since the ENGPAY, the summation of 


engineering and payload weights, is also very highly correlated 


with other variables, 


one must insure that if ENGPAY is in- 


cluded in the final model, the others should not and vice 


versa. 
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Each of the variables are acceptable in the 
regression equation. However, ENGPAY, representing the total 
light ship's weight (LSW) less the weight of the hull (HULL 
ИСТ), 1$ the most statistically satisfactory variable. The 
choice of ENGPAY does have a significant basis in logic since 
the hull cost should be directly related to the total weight 
of the ship's powerplant (ENGWGT) and the total weight of 
ship's armament, c&c equipment and outfitting (PAYLOAD). 
These are the weights. that the hull must be designed to 
carry. From the regression analysis using variable ENGPAY 


the following models were obtained: 


R? - 72.9 o a e E 
SE = 0.6045 Table t-value = 2.03 
ШЕ со = 91.400 Ay 


Table F-value = 13.1 CV = 0.238 
Ш299,1,34) 

This model is statistically appealing and 
intuitively reasonable. After residual plots were examined, 
Many transformations were tried. However, no improvement 
was noted. 

(2) PROPULSION COST CER 

The propulsion cost is highly correlated with 
PROWGT, PWRLD, and ENGWGT, but there are high intercorrela- 
tion among the above variables . The correlation matrix 


of four possible variables are as follows: 
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EROPCOST PROWGT PWRLD ENGWGT 


PROWGT 0.860 

PWRLD 31671 DOS 

ENGWGT 07825 02939 0.519 

RANGE 0.345 0.417 m0. 30 0.558 


The result of the trial to get the best CER shows that two 
explanatory variables, PWRLD and RANGE, are selected to 
predict propulsion cost. The use of these variables seems 
extremely logical. Both represent significant characteris- 
tics of the required power-plant. PWRLD, the ratio of 
maximum shaft horse power to full displacement weight, is 
an indicator of power. RANGE, of course, is an indicator 
of endurance capability. Together, the required performance 
of a power plant is very well defined. 

However, in analyzing the residual plots of 
this model, the evidence of increasing variance was noted. 
This indicates cost increase is a power function of PWRLD 
and RANGE. The following transformation withstands the 
test of logic; 

LOG (cost) = a +(PWRLD) + c(RANGE) 
The phenomenon of diminishing returns to scale has long 
been noted in the field of power-plant design. Doubling a 
ship's horsepower will not double its speed. From the 
regression analysis using two variable PWRLD and RANGE, the 


transformed model is as follows: 
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2 


me = 85.2 L value for pwrld = 13.18 
СЕ = 0.07837 range = 7.90 

K ratio = 32.650 Table t-value = 2.04 
Table F-ratio = 8.5 (.95,33) 

#1799, 2,33) ви = PONIAN 


This model is statistically good and intuitively reasonable. 
(3) ELECTRICAL COST CER 
Examining the data, ELEWGT, NO GEN and TKWCY 
are logically related to electrical cost. The correlation 
matrix of these three variables are as follows: 
ELECCOST  ELEWGT NO GEN 
ELEWGT O. 732 
МО СЕМ 0.734 0.580 
TKWCY 08751 0ٰ 0.541 
All of these three variables are highly related with electri- 
cal cost. However, high intercorrelation was observed between 
ELEWGT and TKWCY. Thus, two variables were employed to ex- 
plain the cost of the electricai power-plant and associated 
equipment. The use of the weight of electrical equipment, 
ELEWGT, has traditional justification. The inclusion of 
BERGEN, an indicator variable for the number of generators, 
also has a logical casual relationship with cost, considering 
the positive coefficient of this variable. From the regres- 


sion analysis, the following model was obtained: 
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me = 68.0 t-value for ELEWGT = 3.82 
БЕ = 0.2937 МО_СЕМ = 3.86 
Шегасісо = 35.111 Table t-value = 2.04 
Table F-ratio = 8.5 95,35) 

m99, 2,33) CV = 0.191 


This model looks good. By examining the residual plots, 
there 1S no indication of the need for transformation. 


(4) COMMUNICATION AND CONTROL COST plus ELECTRONIC 
END COST CER 


This CER demonstrated the difficulty in esti- 
mating the cost of electronic equipment. Selected by logic, 


three variables were examined in the below correlation 


matrix: 
CEE COST C=-EWGT PROTO 
C-CWGT (0 551 
PROTO -0.042 - 0 140 
MS END -0.007 0.484 -0.166 


But no variable was highly correlated with the electronics 
cost. However, C&CWGT served as a traditional explanatory 
variable, representing the amount of communication and con- 
trol equipment as bulk weight. 

When regression analysis was applied to the 
data, the first three variables were taken in, giving logical 
ESt poor statistics, l.e., EE is too low. The binary indi- 
cator variable for prototype ships (PROTO) and another 


indicator variable representing the number of missile 
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launchers (MS-END) might be excluded because of the insignif- 
icant t-ratio. During the examination of the residual plots, 
an inexplicably high electronics cost was indicated for ob- 
servation 24, making it an obvious outlier. Since no 
information could be obtained to support this high cost 
level, this observation was deleted from the data base while 
developing this CER. The model with one observation (24) 


removed had the following statistics: 


R* = 64.8 t-value for C-CWGT = 7.79 
SE - 1.856 Table t-value = 2.03 
F-ratio = 60.634 (522793) 

Eie F-ratio = 13.1 CV = 0.462 

9 199.1,33) 


Even these statistics are poor but acceptable in view of 


no alternative. 
(5) AUXILIARY COST CER 


Three variables are considered in this medel. 


The correlation matrix showed as follows: 


AUX COST PRAXWGT AUXWGT 
PRAXWGT 0.846 
AUXWGT 0.764 0.886 
PROWGT 0.816 0973 0.756 


Both the AUXWGT and PROWGT are highly cor- 
related with the auxiliary cost. But the intercorrelation 
between the two was 0.756. This high correlation seems 


reasonable since the auxiliary and propulsion systems operate 
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as a composite system in providing services to the ship. The 
auxiliary system draws steam and power from the propulsion 
plant and thus does not operate as a separate system. The 
combining of these two weights thus eliminates the problem 

of intercorrelation and logically explain an increase in 

cost as a function of both weights. PRAXWT, a single variable 
consisting of the weight of auxiliary equipment (AUXWGT) and 
the weight of the propulsion plant (PROWGT), would contribute 
to this CER. The model using this single variable PRAXWT had 


the following statistics: 
2 


R = 71.6 t-value for PRAXWGT = 9.26 
SE = 0.5665 Table t-value = 2.03 
F-ratio = 85.724 (.95,34) 

Table F-ratio = 13.1 CV 251 

8999, L, 34) 


These statistics are reasonable. When 
examining the residual plots, no particular transformation 
was indicated. 

GOO OUTFITTING COST CER 

Outfitting costs were available for two 

variables which display logical cost implication. The cor- 


relation matrix for those variables listed below: 


OUTECOST LSW 
LSW 0.844 
CUTWGT 0" 7 0.960 
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Both LSW and OUTWGT indicated a high correla- 
tion with outfitting cost. Two highly intercorrelated explana- 
tory variables, LSW and OUTWGT, could be utilized separately 
to explain the cost. These variables produced approximately 
the same reasonable statistical results, but LSW was selected 
as an explanatory variable due to slightly better statistics 


as listed below: 
2 


R = 71.2 t-value for LSW = 9.16 
SE = 0.3198 Table t-value = 2.03 
F-ratio - 83.894 (.95;34) 

Table F-ratio = 13,1 CV те ІЗІ 

099. 1,34) 


The outfitting cost of a ship should, in essence, be directly 
proportional to the weight of outfitting material, including 
hull fittings, non-structural bulkheads, paintings, work- 
shop equipment, and furnishings for quarters. The use of LSW 
as an explanatory variable is likewise logically consistent. 
As the LSW increases, it follows that outfitting costs would 
increase. When residual plots were examined, neither out- 
liers nor indication of a need for a transformation were 
found. 
(7) ARMAMENT COST PLUS WEAPONS END COST CER 

This category of cost consists of two cost 
items. One is the armament cost, including guns and gun 
mount, ammunition handling and storage system. Another is 


Weapons end cost, consisting of weapons cost after contractors 


68 





delivery; missiles, ASROC system, etc. Armament cost is a 
minor portion of the total cost. The use of one CER to pre- 
dict both costs as an aggregate appears more reasonable. 


The relationship where four variables were considered is: 


A+W COST ARMWGT MS END ELEWGT 
ARMWGT 0.868 

М5 ЕМІ) 0.787 0.681 

ELEWGT 0.805 0.820 0.473 

OUTWGT 0.783 0.858 0.511 0.920 


All of these independent variables are highly 
correlated with the total costs and intercorrelated among 
independent variables. The use of ARMWGT as an explanatory 
variable appears logical as does the use of the indicator 
Variable MS-END, but MS END was highly correlated with 
ARMWGT, as the coefficient of correlation is 0.681. Thus 
it would drop out. It is reasonable to suppose that armament 
costs would increase as a function of the weight of the 
weapons systems. When the data are processed by MINITAB, 


the following model was attained: 


R^ - 75.4 t-value for ARMWGT - 10.21 
SE = 5.208 Table t-value = 2.03 
F-ratio = 104.215 (595754) 

Table F-ratio = 13.1 CV = 0.426 

(12999, 1,34) 


The negative sign for the constant is accept- 


able unless one is attempting to predict the armament costs 
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of a very light, simple piece of equipment. The weight being 
considered in this thesis is heavy and complex. The standard 
error of estimate of this CER is very large, but is considered 
acceptable in light of the wide range of armament costs and 
the small size of the data. When residual plots were examined, 
one observation (obs. 30) is a little high, but with small 
sample like this thesis, it would be acceptable. There was 
no indication of the need for transofmration. 
(8) DESIGN AND ENGINEERING COST 

Six variables were chosen to be considered. 
The following correlation matrix shows which independent 
variable has close relationship with the dependent variable 


(design and engineering cost). 


D E COST ARMWGT PROLSW C CWGT LSW 

HULLWGT 

ARMWGT 0.310 

PROLSW 0.843 0.057 

C CWGT 0.276 0.830 

LSW 0.367 0.886 0.170 0.971 

HULLWGT 0.382 0.768 0.214 0.944 0.972 

PROWGT 0.267 0.965 0.043 0.797 0.836 
0.693 


with design and engineering cost. 


PROLSW is only variable highly correlated 


The significance of 


PROLSW as an explanatory variable in explaining design and 


engineering cost appears valid since this includes the cost 





of drawings, technical manuals, mock-ups and models. These 
costs obviously would be much higher for prototype ships and 
more expensive for larger prototypes than for the smaller 
ones. The use of ARMWGT as a second explanatory variable 
is less obvious, unless an association is developed between 
armament weight and weapon system complexity, wherein in- 
creased armament weight could indicate a more complex weapon 
system with high design and engineering costs. 

From the regression analysis using the two 


variables, the following models and statistics were obtained. 
р 


R = 78.0 t-value for ARMWGT = 3.22 
БЕ = 1.308 PROLSW = 10.13 
Џека 160 = 58.562 Table t-value = 2.04 

Table F-ratio = 8.5 о) 

(#5709 2,33) CV = 0.855 


This model is intuitively reasonable, even 
though CV is a little high. It means this model is not well 
suited to the data. But in this thesis, the CV value is 
considered acceptable due to the small sample size. Several 
other CERs were developed but did not show a better CV. 
While examininç the results of residual plots, four outliers 
(obs. 1,4,26,30) are found. However, those are not removed 
from the data base while developing this CER. 


(9) CONSTRUCTION SERVICE COST PLUS MISCELLANEOUS 
END COST 


This category of costs includes a potpourri 


of odd costs attributable to ship construction - staging and 
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scafolding costs; hull, mechanical and electrical (HME) costs 
resulting from engineering changes, launching costs, trial 
costs, and drydocking costs. Five variables logically related 
to costs were chosen for analysis. 


CIM COST LSW PROLSW Сс СИСТ ۷ھ‎ 


LSW 0.766 

PROLSW 0.354 0.170 

C CWGT 5 "00088 4,46 17 

AR/LSW -0.099 0.319 -0.120 0.282 

HULLWGT 0.822 08972. 02214 4 0.119 


While developing the CER, LSW, C&CWGT, and HULLWGT are found 
to be highly correlated with these potpourri costs. However, 
Since LSW and C&CWGT are also very highly correlated with 
HULLWGT, one must 0 tnat if one of these three variables 
is included in the final model, the other two could not. 
Initially three variables:  HULLWGT, PROLSW, and AR/LSW, were 
used. But the PROLSW and AR/LSW were dropped in the final 
model, since the t-ratios of those two variables are too low. 
The variable HULLWGT is directly related to construction 
costs, Since a large ship needs more engineering change 


costs, and more drydocking costs. The statistics for the 


final CER are as follows: 
2 


В’ = 67.5 S-value for HULLWGT = 8.41 
= 1.993 Table t-value - 2.03 
F-ratio = 70.761 (95734) 

Table F-ratio = 13.1 ey = 0.315 

(.999,1,34) 
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R^-value, is a little low, indicating that HULLWGT alone 
does not explain all of the variance in the construction 
costs data. The remaining variance may be explained by 
other variables. However, other variables did not perform 
any better than HULLWGT, One observation (obs. 24) is an 
outlier in the residual plots. 
b. Single Model 

The single model is an aggregation of all basic 
contract and end costs into a single total cost equation. 
Most of the variables used in 9-sub system were weights. 
Therefore, a logical aggregation of these weights would be 
in the form of LSW, the consisting of all items of outfit, 
equipment, and machinery. Initial attempt was made to utilize 


LSW and some explanatory variable used in 9-subsystem CERs 


in a single CER for TOTAL COSTS. 


TCOST LSW ENGWGT HULLWGT PROWGT PROLSW 

MS END 

LSW 0.915 

ENGWGT 0.866 0.953 

HULLWGT 0.886 0.972 0.864 

PROWGT 0.758 0.836 0.959 0. 693 

EROESW 0.332 0.170 007 0.214 0.043 

MS END 0.812 0.781 DOS 055535 0.716 0.068 

PWRLD 0.269 40288 0 ۶ 0 099 ص۵٣‎ 
Ш 312 
The CER of this single total costs was attained as follows: 
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me = 89.7 t=value for BSW = 7.08 
SE = 7.054 MS-END = 3.14 
F-ratio = 93.077 | PROLSW = 3.48 
Table F-ratio = 7.12 Table t-value = 2.05 
moo, 3,32) (95,02) 

CV = 0.182 


The resultant regression was extremely surprising in its high 
statistical significance. However, the variable PWRLD proved 
insignificant in the regression. Thus the three variables, 
LSW, PROLSW and MS-END were selected as explanatory variables. 
The logic of including LSW as an explanatory variable has its 
roots in its historical success in explaining costs. Larger 
ships cost more. The inclusion of MS-END, attributing an 
increase in cost to the addition of missile systems, is also 
logical.  The.cost of armament, c&c equipment, auxiliary, 
and electrical equipment must increase because all, to some 
extent, support a missile system. The relatively high cost 
of a missile system and associated fire-control equipment is 
easily realized in comparing the costs of a missile ship 
with the cost of a non-missile ship. The variable PROLSW 
accomplishes two purposes. First it demonstrates that the 
cost of a prototype ship is more than that of a non prototype 
ship. Secondly, it indicates that the cost of a larger 
prototype ship is more than that of a smaller prototype. 
Both of these concepts are logical. 

The problem of outlier appeared again while this 


CER was being developed. There are three outliers (obs. 24, 
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28,30) which displayed inexplicably a little high but were 
not deleted from the data base because it is not significant 


yn this small data base. 


В. CERs AND STATISTICAL SUMMARIES 

The Table IV present the 9-subsystem CERs and the single 
CER, and a summary of statistical data is listed in Table V 
pertinent to that set of CER equation. The statistical 
information provided in Table V consists of the following: 


l. The computed t-value for each variable of each CER 
is utilized to test the statistical significance of 
the coefficient of that particular variable. The 
computed t-value should be greater than or equal to 
the critical t-value to demonstrate the significance 
of the coefficient statistically. 


2. The critical t-value is taken from standard student- 
t tables with a significance level of .95 and a 
degree of freedom equal to N-K-1, where N is the 
number of observations and K is the number of inde- 
pendent variables utilized in the entire CER. 


3. The computed F-ratio is utilized to test the statis- 
tical significance of the entire CER and is merely 
the ratio of explained variance to unexplained 
variance (S2). The F-ratio should be greater than 
or equal to the critical F-value to demonstrate the 
Significance of the entire CER statistically. 


4. The critical F-value is taken from standard F tables, 
using a .999 significance level and N-K-1 versus 
K degrees of freedom (df). 

Du R*, the coefficient of determination, is essentially 
a measure of 'Goodness- of Fit' of the regression 
equation to the data. A perfect fit with the data 
would be implied if R? equals 1.0. By definition, 

R7 is the ratio of explained sums of squares to 
total sums of squares. 
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CV, the coefficient of variation, 1S a comparison 
between the dispersion of data points about the 
regression line, and the average or mean value of 
the dependent variable. The range of desired CV 
values would be 0.2 or less. 


df, degree of freedom, represents the number of 
observations less the number of restrictions upon 
the observations. In this section df will always 
be computed as N-K-l. 
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TABLE IV 


SUMMARY OF CERs 


9-subsystem CERs 


Cost 
Subcategory 


Hull Cost 0.0053 + 0.0013 (ENGPAY) 


|| 


О. ОО О-о ПРАВЕ ВО + 
0.0001 (RANGE) ) 


Frospulsion Cost 


|| 


0.1490 + 0.0039(ELEWGT) + 0.2620 
(NO_GEN) 


Electrical Cost 


C&C + Electronics End cost 
Cost =-1.5100 + 0.0328 (C-CWGT) 


Auxiliary Cost = 0.0197 + 0.0023(PRAXWT) 
Outfitting Cost = 0.4360 + 0.0004( LSW ) 


Armament + Weapons End Cost 
Cost =-5.7400 + 0.0825 (ARMWGT) 


Design & Engineering 
Cost =-1.0100 + 0.0065 (ARMWGT) + 0.0015 (PROLSW) 


Construction Service & Miscellaneous end cost 
Cost = 0.0029 + 0.0048 (HULLWGT) 


Single Total Cost CER 


Tcost = -4.1400 + 0.0107(LSW) + 9.15(MS-END) + 
0.0029 (PROLSW) 
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VII. ESTIMATE OF TOTAL COST VARIANCE 


Throughout this paper, emphasis has been continually 
placed upon the development of models that determine esti- 
mates for total procurement cost. An obvious measure of 
each model's effectiveness consists of an estimation of the 
total cost variance associated with each model. Two methods 
are outlined in sections A and B from which two different 
estimates for total cost variance are obtained for the 
9-subsystem model in this paper [Ref. 12]. Note that the 
total variance of the 9-subsystem Model included outliers 


SO as to compare with the Total variance of the Single Model. 


A.  SUMMATION METHOD 

Associated with each CER is an estimate of CER variance 
based on the summation of the squared residual values of 
each observation divided by the degrees of freedom of the 


CER.  Mathematically, for each CER, 


N 
% | 2 
2 К 1=1 (residual) 
j N - K - 1 
where S = estimated variance of each CER 
3 
N = number of observations 
K = number of independent variables 
N-k-1 = number of degrees of freedom 


Within this equation, the term residual is defined as the 


difference between the observed cost and the cost predicted 


80 





as a result of the CER. There is a residual value for each 
cost observation within the data base for each model of that 
Post. 

Since the model predicts a total cost by summing the 
cost estimates obtained from its unique set of CERs, it would 
be logical to assume that an estimate of total cost variance 
would be the summation of the individual CER variance 


estimates. That is, 


L 
=p e 
i=l J 
2 
where S, = estimated total cost variance 
= = estimated variance of each CER 
L = number of CERs in the model. 


Adoption of this technique requires the acceptance of 
one important assumption: That each CER produces a cost 
estimate totally independent of every other cost estimate 
within the model. This assumption is obviously difficult 
to accept. Nevertheless, this method is still quite useful 
because it allows the establishment of a lower bound on the 
cost variance estimate; that is, a value of the total cost 
variance which represents the minimum total cost variance 
that may be attained utilizing that particular set of model 
CERS. 

An estimate for CER variance is automatically calculated 
for each CER by the MINITAB program. Table VI lists these 


individual CER variance estimates. 
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TABLE VI 


ESTIMATES OF TOTAL COST VARIANCE 
BY SUMMATION METHOD 


А. 9-subsystem Model LE... 
۲۰۰۰860-1 0.365 
٣۰٠٠٠۶267 0.006 
3. Electrical 0.086 
ПР СЫС + Electronics End 1 2.009 
m Auxiliary 0.321 
P Outfitting 0.102 
7. Armament + Weapons End 205123 
8. Design and engineering 1.710 
9. Construction service + З 9702 

Miscellaneous End 
Total.: 46.594 
B. Single Model 
Metalwcost. : 41.091 


В. MEAN SQUARE RESIDUAL (MSR) METHOD 

The second method of total cost variance estimation 
involves the calculation of a total cost mean square resi- 
dual (MSR) for each model. The following equation represents 


the general method utilized to calculate this value: 
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ug a 


where N = number of ships 


M = number of variables utilized in all CERs of 


model 


L number of CERs utilized in model 
For example, the total cost MSR for the 9-subsystem model 


employs the following parameters: 


N = 36 
L= 9 
M = 12 
N-L-M = 15. 


Note that by summing the residual values produced by 
each CER for a given ship, the difference between the ob- 
served and predicted total cost is obtained for that ship 
as an aggregate of the individual CER residual values. When 
these total cost residuals are squared, summed for all 
observations (ship), and corrected for degrees of freedom, 
an estimate of variance is produced for the given model. 

Table VII contains a listing of the total cost residual 
values of each observation (ship) used in producing the 
9-subsystem CERs and the Single CER. 

The summation method may be thought of as a lower bound 
on the total cost variance. Analogously, the MSR method may 
be thought of as an upper bound on the total cost variance 
estimate: а vaiue below which the estimate of the total 
cost variance is expected to lie. Implicit within the 


formulation of this method is the assumption that each cost 


group observation is dependent upon every other cost group 
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TABLE VII 


ЕЛЕ COST RESIDUALS (millions, 1965 dollars) 


Observation 9-subsystem Model Single Model 
l 4 а 988385 
2 13.5494 = > 
З 14 6241 -0.7305 
4 -3.3459 =] .9367 
5 2.9428 -0.4150 
6 3 6 0.5294 
7 -0.3072 -3.2439 
8 4.1966 1.1694 
9 8 9 5.5606 

10 5.8366 2.8095 
TL -8.2934 -11.3206 
T2 4.9566 1.9294 
13 4.8993 2.3562 
14 7.4902 5.9238 
15 1.7488 2 32ے‎ 
16 -0.2190 -1.6032 
7 -0.9190 =2.3032 
18 -1.9590 -3.3432 
19 0. 5121 55671 
20 -5.9266 -2.4947 
21 -3.5297 2.4147 
22 -0.8604 
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TOTAL 


23 
24 
25 
26 
]2 
28 
29 
30 
ا 
32 
33 
34 
35 


36 


шав VII (cont'd) 


COST RESIDUALS (millions, 


> 
-21.9065 
1652950 
106725 
255207 
29993 
7.5744 
IIIS 
=), 2009 
5.6624 
0.1824 
-6 
2.7496 


30960927 
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1965 dollars) 


023164 
2021688 
3:9991 

2ھ َ۶ ے 
6.2142 
13.6494- 
3.8206 
O2‏ 
OL‏ 
G52‏ .6 
3552 .3 
0.6345= 
5.2540 


1.8475 





Observation and the degree of this dependence (covariance) 

is assumed to be 1.0. It is highly unlikely that this degree 
of interdependence will exist between all cost group 
observations. However, this assumption allows the creation 
of an expected upper bound and is therefore useful. Its use- 
fulness is further strengthened by the enormous difficulties 
involved in obtaining an actual estimate for the degree of 
dependence that exists between the various sub category costs 
in a given model. If the covariance matrix were easily 
attainable and accurate, the need for upper and lower bounds 
in the development of total cost variance estimates would 

be eliminated. 

Intuitively, the summation method rests upon the assump- 
tion that each observation of sub-category cost (hull cost, 
propulsion cost, etc.) is independent of all other sub 
category costs within the particular model. 

The other extreme, the MSR method, requires that only N 
observations be independent, assuming that each sub-division 
of total cost is entirely dependent on all other sub-division 
of cost. Neither of these methods allows an exact determina- 
tion of total cost variance, Since neither of the underlying 
assumptions is totally correct. Thus, the best estimate of 
total cost variance should lie between these two extremes. 

Table XIII summarizes the data used in calculating the 
MSR value for two models under discussion. The bottom line 


of the table is the computed MSR value and represents the 
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М 

SSR = 2 
L=1 

N = No. 

L = No. 
M = No. 
MSR = SSR 


TAB 


БЕ XIII 


ESTIMATES OF TOTAL COST VARIANCE 
BY MEAN SQUARE RESIDUAL METHOD 


9-subsvstem Model 


ЖОО ТУР 
j=1 = 
observations 36 
CERs in models 3 
variables in model 12 
degrees of freedom 15 
/ (N-L-M) 169.47 
TABLE IX 


SUMMARY OF TOTAL COST VARIANCE 


05 


36 


32 
41.09 


thod 


i | summation me 
| E m P 
w O J MN eU ec sl 
| 

I2-subsystern 46.59 6.83 | 
¡ Model | i { 
a 0 9 — Eb 5 7:7 کی‎ а | 
Single ШЕЛ 09: 6.41 | 
1 Model | | i 

Note: CV = = 
TO 
AVG 


8 7 


90-620 


2 
см | 
c c n 1 
ОЗАТ | 
Пана 4 
Deinen 
۱ 





the expected upper bound of total cost variance as discussed 


esrlier. 


ee ANALYSIS OF RESULT 

Table IX is a summary of the estimates for total cost 
variance calculated using both the summation method and MSR 
method. The left side of Table IX contains data pertinent to 
the lower bound (LB) on total cost variances, while the right 
contains data on the upper bound (UB). The square root of 
these variance estimates (S2), is the standard error of 
estimate (S) and is analogous to the standard deviation. It 
represents a measure of the dispersion or spread that results 
from a less than perfect fit of the regression line (CER) 
with the data. A common use of this measure of dispersion is 
in the computation of the coefficient of variation (CV). 
The CV is a ratio comparison of the standard error of 
estimate (S) to the mean of the dependent variable, in this 
case total cost. Thus, the CV represents a comparison 
between the expected dispersion of total cost and the average 
total cost of the ship in the applicable data base. 

For instance, the estimate for variance (S2) of the 
9-subsystem model is 46.594, using the summation method. 
The expected dispersion or standard error of estimate for 
the 9-subsystem model is just the square root of S2 or 6.83. 
The coefficient of variation (CV) for the 9 subsystem model 
is the standard error of estimate divided by the average 


total cost of all ships within the data base or 18$. Thus 
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the standard error of the 9-subsystem model (using the sum- 
mation) is only 0.18 of the average cost of ships in the data 
base. 

The summation method produces a LB on total cost variance 
and the MSR method produces an UB. Therefore, the CV calcu- 
lated by using the total cost variance obtained through the 
summation method produces a LB on the CV for the model. The 
CV calculated by using the MSR method of variance estimation 
produces a UB on the CV for the model. The ideal situation 
occurs when the UB and LB for the CV are relatively small 
(.2 or less) and extremely close to one another. This would 
imply that the standard error of estimate was small when 
compared to the average total cost regardless of the method 
used to determine the estimate of variance, 

On the basis of the criteria presented in the previous 
section, the 9-subsystem model produces discouraging CVs. 

The lower bounds on the model are acceptable values; however, 
the upper bounds imply that the ratio of standard error of 
estimate to average cost could get as high as 34%. The 
major source of difficulty in this model is the fact that 
the data base contained some non-homogeneous observations. 

Note that for the single model, the upper and lower 
bounds on CV are the same. This is because the single model 
utilizes only one total cost CER. Thus, the MSR method when 
applied to a model with only one CER produces the same 


Variance estimate as the summation method. 
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VITI. COMPARISON OF THE MODELS TO RMC MODEL 


The objective of this thesis is to present ship acquisi- 
tion cost estimating models that provide relatively precise 
total cost estimates. The Patrol Frigate (PF) is designed 
as an escort vessel, thus the construction data is applicable 
to estimate total cost by using each of the models discussed 
earlier. A comparison of these model estimates with the 
existing RMC model estimates will provide a degree of 


validity to the approach adopted. 


e MODEL ESTIMATES 

The necessary input data concerning weight allocation 
and ships characteristics for the PF ship are listed in 
Table X. These parametric input data were substituted into 
the CERs of both models and aggregated according to the 
model structure. Both models' total cost figures in 1965 
Constant dollar base were produced and presented in Table XI. 
Note that a contract profit figure of 10% of total cost has 
been added to each model result, This was done to make the 
model estimates comparable to the estimate calculated using 


RMC model where a 10% profit has been figured. 


В. RMC MODEL ESTIMATES 
Ur SC contract cost 
The parametric input data of PF were put into the 


CER of RMC model based on basic contract costs, and 
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PATROL 


CHARACTERISTIC 
Hullweight 
Propulsion weight 
Electrical weight 
C&C weight 
Auxiliary weight 
Outfitting weight 
Armament weight 
LSW 

Full Displacement 
ENGPAY 

PRAXWT 

ENGWGT 

AR/LSW 

Endurance Range 
MS-END 

NO-GEN 

PROTO 

PWRLD 

NUC 

DE-DEG 

PROLSW 


SERIES 


TABLE X 


FRIGATE INPUT DATA 


VALUE 
1235 
251 
160 

87 

358 
264 

96 
2451 
3400 
1216 
609 
759 
0.0392 
4500 


20 


2451 


91 


UNITS 


Long Tons 


Nautical Miles 


shp/long ton 





COST ESTIMAT 
(SMilli 


9-subsystem CER 


۳٣۰٣٣-۹7۷7 


Hull 

Propulsion 

Electrical 
C&C+Electronics End 
Auxiliary 

۳۲۶۲1 1-60 
Armament+Weapons End 
Design and Engineering 
Construction service 


+Miscellaneous End 


sub total 


TOS profit 


Total 


Single CER 
Teost 


10% profit 


Total 


TABLE XI 


ES OF PATROL FRIGATE 
ons, 1965 base) 


Thesis Model 


(Basic + end cost) 


1.586 
4.888 
2329 
1.344 
1.420 
1.416 
2 90ي‎ 
3٦1 


S9951 


23.615 


20802 


25.977] 


38.344 


3.834 


42.178 


92 


RMC Model 
(basic cost) 


1:796 
30617 
J. 543 
0.551 
1.594 
1.586 
0.551 
S.412 


0 580 


1503 


16.53 





TABLE XII 
PATROL FRIGATE ESTIMATED END COST ITEMS 
(S Millions, 1973 base) 

СО5Т ITEM COST BASE eect 
Design changes $ of Lead Ship construction cost 2.000 
Construction changes % of Lead Ship construction cost 2.500 
Government DD 963 Estimate 1.500 


Engineering Support 


NAVSEC Electronics Sec 6271 Estimate Еа 
NAVSHIPS Sonar PMS 378 Estimate 293526 
H/M/E Equipment Preliminary Equipment List 1.400 
NAVORD Cost NAVORD Estimate 8852 
NAVELEX Cost NAVSEC 6179 Info 0 695 
Metal End cost 22 6017 
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aggregated by the model structure. The total cost figures 
in 1965 constant dollar base are presented in Table XI. 
ЕН End Cost 
The data, supplied by NAVSHIPS as end cost estimates 
in 1973 dollars were presented on Table XII. 
3. Total Cost Estimate 
According to the RMC method for computation of cost 
elements, the total procurement cost of the lead PF is merely 
the summation of basic contract cost including the 10% 
profit and End cost. Since the End cost estimate was given 
in 1973 dollars and the Basic contract cost was calculated 
in 1965 dollars, the End cost data were transposed back to 
K dollars ру .55 to account for inflation. The value 0.55 
represents the average inflation rate for the year 1965-1963. 
The deflator is applicable to government purchases of durable 
goods. Thus the total cost of PF is: 
Basic Contract Cost : 16.53 


End Cost 1246 


Total Cost 28.99 ( $ millions, 1965) 


C. DISCUSSION OF COMPARISON 

The total cost estimates of the PF based on the two 
models presented in this paper and the estimate bv RMC Model 
were listed on Table XIV. Note that the estimates are based 
on 1965 dollars in order to facilitate comparison among the 


Models. The deflator utilized in transposing was 0.55, 
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which was based on information from the Department of 


Defense. 


Table XIII 


Patrol Frigate Total Cost Estimates 
(S Millions, 1965 ) 


A. Thesis Model 


1. 9-subsystem model 23.98 
2. Single Model 42.18 
B. RMC Model 29599 


It must be noted that the profit assumed in this thesis 
was 10% of the Total Cost, while the profit assumed in the 
RMC model is based on basic contract cost without government 
furnished equipment and the so-called End Cost. The esti- 
mates produced by the 9-subsystem model are 3.01 million 
lower in 1965 dollars than estimates by RMC model, whereas 
the single total cost model estimates are away from that of 
RMC model by 13.19 million dollars. Therefore, the 9-sub- 
svstem model can be considered comparable to the existing 
RMC model, but the single model is not in any way comparable 


and requires further study. 
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IX. CONCLUSION 


This thesis has presented a general procedure for 
development of a parametric cost estimates in order to 
familiarize the reader with the approach of this thesis. 
According to the procedures of PCE, two different models 
were developed using the data based on destroyer type ships 
built in 1954-1966. One utilizes 9-subsystem cost group 
CERs and the other uses only one CER to estimate total ship 
acquisition cost. There were some difficulties in using the 
Statistical method for this study. The data was too old for 
current cost estimating, and there were not enough data 
observations to make the results statistically sound, as 
was shown in Table V in Chapter VI. An effort, with a larger, 
updated data base may produce better results. 

A MINITAB computer program has been provided which is 
readily usable in conducting linear least squares analysis 
and the additional time required would be minimal. The 
measure of effectiveness utilized was the coefficient of 
variation, the ratio of the standard error of estimate (S) 
to the average total cost of the ships. The 9-subsystem 
model produced a CV that could range from 18$ to 34$ of 
average total cost (37.62 million dollars). As observed 
in Chapter VII, this problem arose because an attempt was 


made to develop nine CERs with 12 independent variables from 
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а data base that was too small to retain sufficient degrees 
of freedom to make the results sound. The CV for the single 
model is 17% of average total cost. This value is considered 
acceptable. 

On this basis, both models might be used to estimate 
future ship acquisition cost as tools for rudimentary budget- 
ary processes wherein rough ballpark estimates are all that 
are available. 

When these two models were compared with the existing 
ЕМС model, the estimate of the 9-subsystem model was 3.01 
million in 1965 dollars lower than that of RMC model while 
single model estimate was 13.19 million dollars higher than 
that of RMC model, as shown in Table XIII in Chapter VIII. 

‚These facts alone prove only that the 9-subsystem estimate 
is at least comparable to the RMC model. In conclusion, 
two rudimentary models have been developed in this thesis. 
Much careful consideration would be required in the use of 


this model even for ballpark figure budgeting, of course. 
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APPENDIX А 


BASIC CONTRACT AND END COST CATEGORIES 


Contract Cost Categories 


Category Name 


Hull structure 


Propulsion 


Electric Plant 


Communication 


and Control 


Auxiliary 


systems 


Outfit and 


Furnishing 


Includes 
Shell plating, planking, longitudinal, 
transverse frames, decks, super- 
structure, .armor, etc. 
Boiler and energy converter, prop- 
ulsion units, upstakes, propulsion 
control equipment, feedwater and 
condensate systems, etc. 


Electric power generators, power 


drsteribürrönsswitehboards and 


cables, lighting systems, etc. 
Navigation equipment, interior com- 
munication equipment, fire control 
Systems, radar systems, radio com- 
munication systems, sonar systems, 
EEC. 

Heating, ventilating, air con- 
ditioning, plumbing, elevators, 
arresting gears, rudders, etc. 
Hull fittings, nonstructural bulk- 
heads, painting, equipment for 
work shops, furnishings for 


quarters, etc. 
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Arm Armament 


D&E Design and 
Engineering 
Services 

C/S Construction 


Services 


End Cost Categories 


Guns and çun mount, ammunition 
handling, storage systems, other 
weapon systems handling and 
storage systems, etc. 

Contract drawings, working draw- 
ings, technical manuals, lofting, 
mock-up and models, etc. 

staging, seatfolding and eribbing, 
launching, trials, cleaning ship, 


darydeeking, reto. 


Weapons Weapons costs after contractor delivery: 
End cost missile, ASROC systems, etc. 

Electronics Electronics costs after contractor 

End cost delivery; radar, NTDS. fire control 


systems, etc. 


Miscellaneous Disaster costs; cost of hull, mechanical 


End cost and electrical changes; post deliverv cost, 


etc. 


meOsT Total End Cost 


Basic Contract cost + Profit 
+ Miscellaneous End cost + Weapons 


End cost + Electronics End cost. 
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АЕРЕМОТХ С 
DATA BASE MATRIX 


info 


NAME COUNT 


COLUMN 
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APPENDIX D 
COMPUTER OUTPUT (ANALYSIS RESULTS) 


Bee: 1.HULL COST CER 


corr РЕС с1 c35 cit c3 c31 c2 


HULL COSI ENG PAY LSW ENGWGT ARMWGT PROWGT PRAXWGT 
ENGPAY 0. E54 
ISW 0.847 0.981 
ENGWGT 0.846 (.986 0.953 
ARMWGT 0.878 0.946 0.886 0.964 
FROWGT 0.784 0.918 0.836 0.959 0.965 
ЕЕ ИСТ 0.838 0.980 0.936 0.998 0.971 0.973 
HULLWGT 0. 796 0.908 0.972 0.864 0.768 0.693 0.835 
regz UN C30, st. res c72 pred. y c73 
Peo REGRESSION EQUATICN IS 
Y= 0.0053 +0.0913 X1 
STE DEV, TeRATIC = 
CCIUMN COEFFICIENT OF COEF. 6092750. 
-- 0.0053 0.2827 Dom» 
X1 ENG EAY 0.0013477 0.0201410 9.56 
ЕНЕ ОЕ" . OF Y ABCUT REGRESSION LINES IS 
WITH ( 36- 2) = 34 DEGREES OF FREEDOM 
R-SQUARED = 72.9 PERCE 
R-SQUARED = 72.1 DERCENT, А LJUSTED FOR D FPF. 
ANALYSIS CF VARIANCE 
DUE TO DF 55 MS=SS/DF 
REGRESSICN 1 33.3966 33.3966 
RESIDUAL 4 12.4239 0.3654 
TOTAL 35 45.8206 
F-ratio = 91.400 
СУ = 09.238 
Х1 Y PRED. Y S DE ° 
ROW ENG PAY HULLCOST VALUE PRED. Y RESIDUAL STRESS 
52 2818 5.480 3.803 0.167 1.677 2.89R 
33 2818 5.460 3.803 0.167 1.657 2.85R 
R DENOTES AN OBS. WITH A LARGE ST. RES. 
DURBIN-WATSCN STATISTIC = 1.38 
aver с20 
AVERAGE = 2.5306 
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moe с/2 vs c73 
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note: 2.PROPULSICN COST CER 


c2]! c3 c5 c35 c6‏ کہ کت 


BOFCOST 7 PWRLD  ENGWGT 
PROW GT 0.860 
EWRLD 0:6 1 22039 
ENGWGT 0292 > 0.959 0.519 
RANGE 0.345 0.817 -0.301 0.558 


ВЕ. c21 2 с5 c6, 5t. res c74 pred. y c75 


BHESREGRESSICN EQUATICN IS 


Y=- 6.03 + 0.545 X1 «0.0008 X2 
ST. DEV. T-RATIO = 
CCLUMN COEFFICIENT OF COEF. COEF/S.D. 
سو‎ -6.02 7 1:062 OT 
X1 PWRLD 0.54485 0.05487 3:93 
X2 RANGE 0.0008119 0.0001159 7. 00 
THE ST, „DEV. OF Y ABCUT REGRESSION LINE IS 
WITH ( 36- 3 = 33 DEGREES OF FREEDOM 
R-SQUAREL = 77.9 PERCENT 
R-SOUARED = 76.6 PERCENT, ADJUSTED FOR D.F. 
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ет: res c76 pred. 
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note: 
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ANALYSIS CF VARIANCE 
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pot c78 vs c79 
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0.90 1. 29 0+ 0 1.80 2.10 2.80 


По. СЕС + ELECTRCNIC ENE COST CER 


corr ЕЗ) ес9 с10 с11 


E OST C-CYGT EROTO 
CFC WGT 0.551 
PROTO “0.042 -0.140 
MS- END 20-007 0.484  -0.166 


EN-ecr c32 1 c9,st. res c80 prsd. y c81 


THE REGRESSION EQUATICN IS 
Y  - (.769 40.0315 XT 
ST. DEV. T-RATIO - 
CCLUMN COEFFICIENT OF COEF. COEF/S.D. 
= 7 1.494 -0,51 
X1 C-CWGT ` 0.031452 0.008162 3: 85 
IRE ST, DEV. OF Y ABCUT REGRESSION LINE IS 
WITH ( 36- 2) = 34 DEGREES OF FREEDOM 
R-SQUARED = 30.4 PERCENT 
R-SOUARED = 28.4 PERCENT, ADJUSTED FOR D.F. 
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ANALYSIS CF VARIANCE 
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2U of 7 


OF 7 ABCUT REG RESSION LINE IS 
33 DEGREES OF 


CCLUNN 
EV. 


ramcve outlier cbs. 
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ANALYSIS OF VARIANCE . 
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LARGE INFLUENCE. 
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2.0 


3ق وو ے 8ء 
-2.0- 


кнн РЕРНИ 
e e 
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DURBIN-WATSON STATISTIC 


plo 





5.AUXIIIARY COST CER‏ ھجم 


БЕБЕ с2Ц с31 c12 са 


AUX COST PRAXWGT AUXWGT 
PRAXWGT 0.846 
AUXWGT 0.764 0.€86 
FROWGT 0.816 0.573 0.756 


ШЕШЕ G24 1 c31, st. res c84 pred. y c85 


REGRESSION ECUATICN IS 


Y= 0.0197 40.0023 x1 
ST. DEV. 
COLUMN COEFFICIENT OF COFF. 
= 0.0197 0.2595 
х 1 PRAXWGT 0.0022529 0.0002433 
IHE ST, DEV. OF Y ABCUT REGRESSION LINE IS 
ITH ( 36- 2) = 34 LEGREES OF FREEDOM 
R-SQUARED = 71.6 PERCENT 
E-SÓUAREL = 70.8 PERCENT, ALJUSTED FOR D.F. 
ANALYSIS OF VARIANCE 
DUE TO DF 55 MS=SS/DF 
REGRESSICN 1 27.5174 27.5174 
RESIDUAL 34 10.9128 0.3210 
TOTAL 35 36.4303 
F-ratio = 85.724 
CV = 0.251 
X1 Y PRED. Y ST.DEV. 
ROW PRAXWGT AUX COST VALUE  PRED. Y RESIDUAL 
1 Ms) 1. 0900. 2.5992 70.1018 1.519 
12 1126 4.0200 2.5564 0.0998 114636 
R DENCTES AN OBS. WITH A LARGE ST. RES. 
DURBIN-WATSON STATISTIC = 1.76 
aver c24 
AVERAGE = 2.2575 
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EIS CSU vs c85 
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ETS 6.OUTFITTING CCST CER 


CORR C25 c1 c13 


CUTE 
LSW 0 
CUTWGT 0 


LSW 


С 
қ 0.960 


OST 
844 
321 


mye c25 1 cl, st. res c86 pred. y 287 


THE REGRESSICN SGU ATICN IS 
Y= 0.426 40.0604 x1 
ST. DEV. Т-ВАТІС - 
COLUMN COEFFICIENT OF COEF. СОРЕ 5 0. 
E „4358 0.1487 3 01 
x1 LSW 0.00038576 0.00004212 9. 16 
THE ST, DEV. OF Y ABCUT REGRESSION LINE IS 
WITH ( 36- 2) = 34 DEGREES OF FREEDOM 
R-SQUARED = 71.2 PERCENT 
R-SOUAREL = 70.3 PERCENT, ALJUSTED POR D.F. 
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ANALYSIS CF VARIANCE 
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Verge os 
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Ene 7.ARMANENT * WEAPONS END COST CER 


СЕ СЭЗ C14 C11 C7 с13 


AtW COST ARMWGT MS-END ELENGT 
ARMWGT 0.368 
HS SEND 0.797 0.681 
ELEWGT 0.805 C.€20 0.473 
CUTWGT 02783 0.857 0.511 0” 920 


ШМЕЙЕ С33 1 clu, st. IDes c88 pred. y c89 


Seen eGRESSION EQCUATICN IS 


У = - 5.74 40.0825 Х1 
ST. DEY. 

COLUMN COEFFICIENT OF COEF. 

о ES 737 1.961 
x1 ARMWGT 0.082469 0.008079 
THE ST, „DEV. OF Y ABCUT REGRESSION LINE IS 
WITH ( 36- 2) = 34 DEGREES OF FREEDOM 
R-SQUARED = 75.4 PERCENT 
R-SQUARZD s 74.7 PERCENT, ADJUSTED FOR D.F. 
ANALYSIS OF VARIANCE 
DUE TO DF SS MS=SS/DF 
REGRESSICN 1 2826.33 ed c 
RESIDUAL 34 922 20 27.12 
TOTAL 35 3748.53 
F-ratio = 104.215 
СТ = 0.426 

11 Y PRED. ¥ ST.DEV. 
ROW АВМЯСТ А+Н COST VALUE PRED. Y RESIDUAL 
30 ЕМЕ 40.610 25.271 1.546 15.339 
R DENCTES AN OBS. WITH A LARGE ST. RES. 
DURBIN-WAISON STATISTIC = 1.36 
aver c33 
AVERAGE = 2205 
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ШОО C34 с1 с15 с9 сй с?2 


ES 9,CCNSTRUCTION SERVICES + MISCELLANEOUS END COST CER 


CENI COST LSW PROLSW C-CWGT  AR/LSW 
LSW 0.766 
FROLSW 0.354 0.170 
C-C AGT 0.775 0.971 0.121 
AR/LSW -0.099 0.319 پ0 0-۔‎ 0282 
HULLWGT 02822 0.972 0.214 0.944 0.119 
Bar e3u 3 c2 с15 ch, st.zes c96 pr2d. ¥ c97 
HT REGRESSION ECUATICN IS 
Y = i E +O. 6 d X1 «0.0004 x2 
- 30.4 X3 
sr... DEN. E AE 
ОНОМ COEFFICIENT СОЕ CEOEL/S DE 
-- 1.839 lee Su 1. 49 
X1 HULLWGT 0.0047349 0.0) 05480 dc 
X2 PRCLSW 0. 0003732 0.0002134 а 
X3 AR/LSW -30.35 "0+ ٦ -1.91 
ШЕГЕ i: i. 23۲۶۰۳۰۰۸۰6۰ 6 ٦ 1 IS 
WITH ( :6- 4) = 32 DEGREES OF FREEDOM 
R-SQUAPET = 73.9 PERCENT 
R-SQUAKRED = 71.4 PERCENT, ADJUSTED FOR D.F. 
ANALYSIS CF VARIANCE 
DUE TO DP 55 MS=SS/DF 
BEGSRESSICN 3 307.331 102.460 
RESIDUAL 32 108. 837 3.401 
TOTAL 35 416. 217 
F-ratio = 30.126 
CV = 0.290 
EM -gr c34 1 c2,st. rss c7! pred. y c72 
EHE RFGRESSICN ECUATICN IS 
Y= 0.0029 *0.0048 X1 
ت‎ 9 Т-ҚАТТО - 
COLUMN COEFFICIENT OF COEF. COMP Sis. 
-- | . 0029 0.8256 0.00 
X1 HULL WGT 0.. 004 812 1 0.0005721 3.41 


IHE رت‎ OF Y ABCUT REGRESSION LINE IS 


S 
WITH 6> 2) 34 DEGREES OF FREEDOM 


1 
B- SQUARED 
R-SOUARED 


ےہ 
= 


ENT 
EBCENT, ADJUSTED FOR Б.Р. 


124 





70.761 


ANALYSIS CF VARIANCE 
9.313 


Е-гатіо 


СҮ 


PS 54» 
e(t ° 
соо с E 
Си ст 27 = о) 
14 e° ° e ° = 
e (N - fi] 
Es y 1 => 
п + 
fr, 
=. 
+ + 
HOTO ONO! 
r <F CO un [11 
DOM O rn 
C e ° ç ° ра 
HINNAN « + 
п ' | r3 
m + + 
са Ен 
et 


ОМ e e o o ~ 
• 2102 2 О О et 
Hm HD 
na un 
414 
io = 
Де ОсО کی‎ «© + + 
mc OCO me ° 
HINMMNM «t vec 
ex ee 9 + 
рро Оу СЧС СУ эй 
a ee < мо 
би Hg ںا‎ ° + + + MI 
TN MH “9 + 4t 4t dt 3€ СУ ж + 
HO E m 
-HOOO9 HT WN ° 
NQI“M ж H O 
ON mM E + N 
U % ее, ° о rT 
O30D0 Um Es 
=т= ee nm y (N 
+ OO m + 
O 22 O 4 ۱ 
a O II 
“ЕО” بے‎ U} и + + 
РАСУ МО ~ [~ ЕН + > чє 
ENAN NN «Ж о 
~ (с | БІРІ = =+ =< v 
4 че 1 ma t = 11410189 ии 
> оо = Qui о ro <> e e 
اعد‎ == H > о. ° ° 5 
FRI qm це 4? m N = o 
۲ج‎ +۶ AQ m q © 
Onmmm => | > ۱ | 4! 
0 0475 c | G ۱ ра 


С72 


І---------І---------І---------І---------І---------І 
1520 


25 


ж 


leo 10.0 
125 


270 


2575 


-2.0- 





MSC TAL COST CER 


nets > 


(со СТ c35 c2 c3 c15 c11 c94 


END 


LSW ENGWGT HULLWGT PROWGT PROLSW KES 


Min" 
ATM 
WON O 
ھی‎ 9 © o 


OOOO 


stom noon 
OWN e 
ONE MN 
ees. 9 ө 


Ооо‏ ںی 


MODO r O 
чог MF رن‎ oO 
Сосо те У СЧ 
%4 9 е 9 9 9 


оооооо 


En OOO CN CN O, 


u) 


om Do 


ONDOT-MON 


O 


ЕСОООС«СОСОСООЭО 


ed. y c99 


مس 
o‏ 


2390 


EN ccr c29 4c1c11 c15 c5, st. res 


19 X2 


| ° 
ошооо 

< «ог сцэ 

HU о ° © * e 


ба" ОСУ СУ ОЗ 
«npa! e 
сз] 
Дә, 
HU) 
° @ 
> u O Y” CN CO 3 
A mM + СОШ СО 
EA reve 
O ee . 00.0 
% NONDO ° 
Fike O QO 
no e O 
© » 
C 
ЕН 
= Oy rr Oy CN 
ANONN 
сосот ~ О 
O eN «nO 
АС "Го (С о 
إ بتا‎ OO 
Ha . O 
М O • 
© © 
O 
es Ox 
>; =A 
> 6K74 
H IUM 
O Ff UYUJI E 
Opens 
ےم‎ CN rry > 
P< >< > >< 


OF Y ABCUT REGRESSION LINE IS 
31 DEGREES OF FREEDOM 


DEV. 


Eo DIS. 


ADJUSTED 


ANALYSIS OF VARIANCE 


Бот 
Amon 
Neo 
NNO 
Wn = 
и = 


= 


INO OW) 
W=t + OY 


о‏ ریت 


جم ہس ہت 


п а Еч 


= 72.345 


F-ratio 


C. 180 


CV 


2 


y c74 


ЕЕЕ 629 3 ci cll c15,st.zes C73 pred. 


ео 
— 


E X2 


QOIMNDORN 
O em 00 
° MONO 
Et نی‎ © 
ЭО . © 
о ° 
© 

~ 
200UNO 
еси с 
= с O 
O оС $400 
HIN 
RIO о 
В . ОО 
m О 0 
O O 

O 
= A= 
>} aU) 
e ہے بعا‎ 
ہم‎ = PD 
о. ои 
O 13M, 


126 





п 
ہم‎ 
51 = 
=” O 
но 
- جم‎ 
51 
= m 
O m 
+4 
п в 
п о 
m 
m U) 
e fm 
21 P3 
m m 
e 
F m 
=> A 
O 
m € 
AL (Y) 
> 
і 
fu 
О мштж 
zT 
e 
> | 
zi NO 
OST) 
ما‎ 
• О 
Lira 
nm 
Ta 
m II E 
I H 
HNT 


ADJUSTED FOR D.F. 


ANALYSIS CF VARIANCE 


تب٣ ی9‎ 
AWE 
` ° ° 
Mo 
ОС 7 

II NO 


F-ratio 


CV 


33-077 


0. 182 


- bd Pd bd Dd 
t f m m 
p3t— у OO CO rr) =+ 
по Ооо с 

оо Фо 9 о 9 
ЕНСОСЧСЧСООС«ООО 
п | | | 


„4 
«ӨЗ ОГ-“ОСЧО> 
DE Oone 
C . ọ è с. ss? 
Но со Зил СУ 
Өс”!!! 
fx] 
са 


аы атое 
» о-о 3 
[+] ° © ° ç * e ө 
AANS => mm 
elt} 
۹ 
nm 


MPG MON 
DOANONN 
е] ° è è o è o 

(«eom oce uw) 

е» СУ + 0000 فا بب‎ 

m 

Ay 


P4EHO хоз Ор 
AMATON 
С) • • • • е + 
ںا‎ + mn e Oca 
нЗ «осоо 


"(ООСС СО 
P< NINO OY r~ 
IND MTONWI 
сүзл? 


EX OOO 
۷۷۷۹۰۳۷ 


21 


Pees IN=WAITSON STATISTIC 


ave 


poc c73 vs c74 


۱ 
enun 
(~ e 
Um 


C74 


І---------І---------І---------І---------І---------І 


ic 


+ 
% ЈЕ 
+ + 
+ + 
+ 
+ 
€ NA NA + 
N 
* 
+ + 
+۴ 
+ + 
ии брони ١ا۹‎ 
U? u) из із из 
° ° ° ° ° 
сч ي‎ O о e 


۹ 


40. 60. 80. 100. 


20. 


127 





0. 


ДЕ. 


га. 


15. 


14. 


h S I OF RET ERENCES 


ee older, C A- Ап Introduction to Equipment Cost 
Estimating, RAND Corp., RM-6103-sa, 1969. 


Baker, B. N., Improving Cost Estimating and Analysis 
in DOD and NASA, Ph.D. Thesis, George Washington 


University, Washington, D.C., 1972. 


Booz-Allen Applied Research, Inc., Cost Management 
Methods, 1971. 


Bruce, M. M. and Sovereign, M. G., Parametric Cost 


Estimating with Application to Sonar Technology, 1973. 


Bl EN. S., and Sandrini, L. M., Parametric Cost 
Estimating, paper prepared for Defence Systems Analysis 
۶۲۳۴۹١۴3710, ۰ 


Center for Naval Analysis Report, Escort Ship Cost 
Model (ESCOMO), by R. V. Wilson. 


Chief of Naval Operations, OP-96D, Independent Cost 
Review, S-3A Program, 1972. 


Chief of Naval.Personnel, Advanced Submarine Sonar 


Br ehnology, Volume 2, NAVPERS 93595, 1965. 


Bean, С. R., Statistics and Econometrics, Hort, 
Rinehart and Winston, 1971. 


Graybill, F. A., An Instruction to Linear Statistical 
Models, McGraw-Hill, 1961. 


Helmer, F. T., Bibliography on Pricing Methodology and 
Cost Estimating, Dept. of Economics and Management, 


USAFA, Colorado, 1972. 


Hernon, D. M. and McCumber, R. R., Estimation of 


Пао ре Naval ohi pikrocurement Costs, Master's 
Thesis, Naval Postgraduate School, 1973. 


Klein, M. R., Treating Uncertainty in Cost Analysis: 
The Beta Distribution, (Preliminary version), Resource 
Analysis Group, OP-96D, The Pentagon, 1973. 


Military Equipment Cost Analysis, RAND, prepared for 
the Office of the Secretary of Defense (Systems Analysis), 


19571. 


128 





INITIAL DISTRIBUTION LIST 


Defense Technical Information Center 
Cameron Station 
Alexandria, Virginia 22314 


Library, Code 0142 
Naval Postgraduate School 
Monterey, California 93943 


Professor Michael G. Sovereign, Code 55Zo 
Department of Operations Research 

Naval Postgraduate School 

Monterey, California 93943 


Associate Professor Shu S. Liao, Code 54Lc 
Department of Administrative Sciences 
Naval Postgraduate School 

Monterey, California 93943 


LCDR Baik, In Hwa 

Yimho Jutaek B Dong 101 
4-100 SUBINGKODONG YONGSANKU 
Seoul, Korea 


129 


No. 


Copies 






































| 
| 


ПІШІП 


|| 


| 


| 
| 
| 


| 


— 
= 
ا‎ 
 — с=ш=. 
та 
ји 
— 
— титл. 
— س‎ 
и 
سے ے‎ 


| 


| 


| 


| 


| 


| 
| 


| 


\ à ы Yw 
لے‎ TERRA 
A w ہک‎ di 
ASA ریم‎ 


es e < A 


Fede, P Yr o Uns 


VAN ER 





PORTE. 
А AE YS 


C ساوج‎ = 

PAR ыы м 
А q {5 qii ; 

= е 

ڈور نید 

عو ا 4.4 


DUDLEY KNOX LIBRARY 


St ых 


Е 









Poe TB Wye 
[ХАЛ ZI 


۳ رر یں 


بش ا 
ығы‏ 


ЖОЛ Aj 





LII 


El, 


ا A‏ دیما 



































































ER نے نف‎ 
d edi و لیر وین را‎ 
ad ya Wer. he a 
= АА Ч 2 4 » Ep - 
"5 ضرق ہی‎ E 
voa 
Мун у + 
" Ld “. 
a Б a 
. 
РА 
r » 
" 
А ۰ 
" - « 
« Р E 4 
2 
= = ۹ 3 
. „ 5 - eS 
Р Pr I 
- í » - - ~ 
` - š Ё > P 
a < 
. sP. 
- 4 » - 
„ ~ ү E 
" P Е Р E 
Р ЕТ a қ 
- d Р ° = « 
А р яғ, - - 
- - «2 E ea - 
е ч Б <“ di - а 1 2 
" y نے مم چم‎ PIER dm 
= ~" `j 5 > شر‎ 2 7a 
» - » Ce F E 
ы 2 k. = ~ „. - Й Е E > ж" 
Р = añ go >. 
ы LI P > „> P > m e 
4 А Lar Р, 2 £ ” I - = ~ E 
~ + « Р dii ad س تو‎ ү мы 
E > 5 Р > » P et نے‎ ~ 
~ #4 =. Ра ЫР Ld 
= ы ا رر کی‎ » 
Б p m ç ~ СР " > > ” “= 
= ñ == = = - " 
P LP a Е = > nd d ы 
3 P = z J е: - سر‎ 
ж m 59 - سے‎ ~ ~ ~". 
" Бі А P Е - wore - 
Б NE. ш E 4 а аа ER vt Ap 
-. И Я EO М - Е кай л ы 
8 z Z ГЕ de de > > че. д Т" я 
y Ы m E М Ж Е = “Ten ~ Г. 
Я 
PP Р . + арр ےو اھ‎ D Res 
“ - >, 2 7 2 5 + ы” E > 
f ? £ à - 4 > - = m zh абы A A 
4 T # z P "T NEL a ->ja T 
“ « " Be - اللہ‎ 27; u ји = ۴ ; — + E ? 
dE oY 4 л L zd Т سر‎ el ور 27 ضف‎ RP. т > Je РЕ 
А š , ا ا‎ „а es e ~ op “e ری‎ e 
© ГЕС „ - E =”. T - ” ж ¿L аа. s 
, Р PE یں‎ e ° E а-ы = =, 
" 2 E > б - 3 ¿e 3; ¡e LIE v u nai PL E 
E 2 ë в » A aire T ы cT جب ارتا‎ 
С ” LE Zu d L г * y » сыма ы 47 La 4 Е 
- » б БЕ ~" 7, “ е Р" m پر‎ 
+ نی‎ d . < i PIE к سہ‎ = 
کے‎ , “< 4 í š tain б - » ia 
d “a لے کر‎ “md uU yu کے بر‎ Patt ~ رہ ہی‎ we + 
р E T - = و‎ À 5 ix 
ДЕЈ D EXE ہس‎ 
ےھ 3 27ھ‎ СИТА -— عو رف‎ | a Z MO LU: 
= 7 " کرس رک‎ ж ab ب‎ oh LEM ae od en 
u E А Б ““ س ہے‎ о + “о ы 
# P a ғ ۵ " E . Г. “ъ= уе - 
d „луй E E Cs A A Ry 7 
v A МАРТ. دات غ ي عم ب‎ P S ido Saar 
P > Т > - 2% -— er У жа у A 
ы = рт N = ce ED لے ر کے‎ эв — کی و اس وی مد‎ 
ہت‎ М Pr ہے ےسہ تی‎ mer ہت‎ E ا‎ LI 
2 — کہ‎ wa м yA E Lap و بر ا ا‎ — r { 
E- ری مہ‎ es) d ade EEE EA х 
و ی‎ rS ыт, w = W yi Rn e ےط‎ | aue =; 
25, F و اد‎ Petar 0 o Ма таты ЖС? 
б КМ“ 77 ж HL РЕН 
д - 4 = 
X ; L 4 М Г „ esses 
E Й » ےر ےم‎ 
E E n عو‎ PE 
E HE dee 
c М » دی کے‎ - 
. p^" ane руг дд, 
| w r RAT EZ 
М тыу 
L لو ہی ںہ‎ 
y а Мат Ж! "> 
А ғ ғ. 
Р - rE 
ا‎ 
, ` , $ < AA 
a 4. رر یں سس‎ 
Š a 
LI کال‎ ` а ЕР E 
= В , ص حر بر نر ںی‎ Frer nn, < 
О - L аА а оа а pro ہے‎ 
g z аҚ, К سے کے شس‎ ЖҮ ۹ 
А ‘nis 4 ; 4 We t ы раны | УН h - ЧЕ, 
» ` ú f „У +: s Ж. >. ? 
To: Zi naf کی کر سے‎ 
4 - Ç м ОШ" И т 
б LIP y : И қ x А ДЕ РА 
dz ar 7 М - L Т 15 
5 z y 9 d Ak ba a ade Li 
0 м عرے‎ АР ӨТ rat 
а B xi ~ к ; . АМОР j رج اھ‎ Ta 
2 Р ñ + Pep eee ере ЫЫЫ ےو صو ر۴ سس تر‎ A 
А ` ¥ 2 a КА = (ТҮ "did 1 mm tu t ue. 
а E d. Б ۱ 2 i я رن و رجہ‎ r a^ fate E argue gr em. о | 
bd N اس‎ ға d. d arm ë سید‎ arp и РЕ 
" a сИГ С r „аг ИР I LN : V ves. а аф 
er i .. e + ¥ A اب , کر‎ Ml ار و ور دہ‎ г fl taht on FE gor, аА 
б n П Р 14 М + . М Wr ғ + HT AA АТАУ м 2 de ja ye FATAL یی‎ и 
Р P " d JU cre ^ $ 9 ery Mii Dian TAS (PA "و پر‎ k L وج‎ EMITAN 
А М js ا‎ By О unu EPIA си, ار رتو ار ند‎ Маљен 
- = 4 А 7 б £. SEI. Ar. ім = AA 74 PL ade قر ا‎ 
4 кысқа, Fe LES сенде ере А ТЕ do 
Е + u Зыр اس یھ‎ Sel DN FP A LE 
۰ б) РЈ & y y E 4 = 
va PESAR Р 1 $” y a ГЕ, ма Се. ух СЫ B Eq Miu pre er Pa De AE AA 
° y T к DL b Ж Q 
: " or де e Re “ - سی میٹ‎ P Ру је A ерини 
TA f 2 р So a.» A E Y be ih UL e dr ЗЛ РО ce” 
Es Ç м ; ыа, # + Й ж = وو‎ РЕЈ Ф: "t «^» LL. Sedi А АСЫ, 
T tl z x Ji 5» Cra pe | 1 EL ہد‎ P e Ls ж; Га ы А 
Ы >, ә «$ к Г а ти T f f У x 2 13 5 5 9 
” ` ae - To 1 [ES 2 w s, a ed DUC “ Г I ^ 7 A P r > 
М М 7 2 * ГЕ y Ж . % Medi od и ged ы E Р sE 
, ы d ы : 7 таи „ы .. fg "ө at шь 
ғ E А Ы ۱۔‎ yr. نھد‎ rr. 
4 a М £ p^. di ud ЖА 7 ebd “~ 
” Ы we С. ы ғ - 1 rA 
f d 1 АО ор ro; 
— - ` v + , Ü LI 
N Š ў E e ~ r 7 ہے‎ X М ER — ya 
асу مو وق وش‎ AE + ورک تر لی کو وو رر و ہا‎ TRIER 
А ود‎ — ДШИ. a 1 N" rq A jede, А“ vu سر و سے رام‎ aA ars بی شس‎ 
« E سا ہر وید تو رھ‎ У, ДЈ ДР" "wy y ہیر ا ای ہا‎ ND м’ =: 
A è Ж 7 rs بس ہی‎ a Sr ç ر یا ا‎ A 2 A n LACAN р 
u J š 5 + f г ; > T^? ¿s Fe p'ata و ہف‎ САГА Y "€ Wd» ~ ےر و ہیں‎ РФА 
, - es n С n VII CLER а pd ji Mat ТҮ VTA EE e 
ш E ” SN ME uo 2 e Ix ҮА, BEN EN рч > w 47 A کر‎ FT Re 
* Ж. rz J کے یف‎ Ме ГАР ГИ Ж) € ty ys EL چا‎ 
jr rye ; بر سز کرو لاف‎ PCIE ыйл اس ری ا ہار وق‎ 
, AL Џ FP POT WI de P ےی پر ول ہاب‎ S 
- ap ar АУА RT. ЯЗ : H Тағ 
. 0 FS 3 т С رھ‎ Vy M IN 
LE £ f т > ёт ЕА 1 ДЕЧЈЕ 
" ЏИ" ES y у "an" РР » 
) б 773 4| > *; З er wwe № 
у 
iy 


